-- Logs begin at Mon 2022-05-23 16:31:21 UTC, end at Mon 2022-05-23 17:40:22 UTC. -- May 23 17:02:54.598652 dv-cinder-842998-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 23 17:02:54.607642 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 17:02:54 2022] *** May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: nodename: dv-cinder-842998-1-iscsi May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: machine: x86_64 May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: clock source: unix May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: pcre jit disabled May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: detected number of CPU cores: 4 May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: current working directory: / May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: detected binary path: /usr/bin/uwsgi-core May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: your processes number limit is 47680 May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: your memory page size is 4096 bytes May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: detected max file descriptor number: 2048 May 23 17:02:54.609693 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: lock engine: pthread robust mutexes May 23 17:02:54.610612 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: thunder lock: enabled May 23 17:02:54.610612 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 17:02:54.610612 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 17:02:54.653748 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: Python main interpreter initialized at 0x555a329249c0 May 23 17:02:54.653748 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: python threads support enabled May 23 17:02:54.653748 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: your server socket listen backlog is limited to 100 connections May 23 17:02:54.653748 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: your mercy for graceful operations on workers is 90 seconds May 23 17:02:54.654077 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: mapped 403077 bytes (393 KB) for 2 cores May 23 17:02:54.654146 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: *** Operational MODE: preforking *** May 23 17:02:54.654423 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: *** uWSGI is running in multiple interpreter mode *** May 23 17:02:54.654423 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: spawned uWSGI master process (pid: 80546) May 23 17:02:54.654633 dv-cinder-842998-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 23 17:02:54.656176 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: spawned uWSGI worker 1 (pid: 80556, cores: 1) May 23 17:02:54.656176 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: spawned uWSGI worker 2 (pid: 80557, cores: 1) May 23 17:02:54.656176 dv-cinder-842998-1-iscsi devstack@keystone.service[80546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 17:03:00.262320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:03:00.262320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: from cryptography.utils import int_from_bytes May 23 17:03:00.263133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:03:00.263133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: from cryptography.utils import int_from_bytes May 23 17:03:00.263537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:03:00.263537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: from cryptography.utils import int_from_bytes May 23 17:03:00.263643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:03:00.263643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: from cryptography.utils import int_from_bytes May 23 17:03:00.311377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:03:00.311539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:03:00.311614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:03:00.311699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:03:00.311768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] command line args: [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:03:00.311837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] command line args: [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:03:00.312000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:03:00.312093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:03:00.312161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ================================================================================ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:03:00.312220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ================================================================================ {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:03:00.312447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] admin_token = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.312585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] admin_token = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.312687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config_dir = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.312759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] config_dir = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.312890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.312968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config_source = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] config_source = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] debug = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] debug = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.313936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_config_append = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.314975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_config_append = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_dir = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_dir = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_file = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.315968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.316962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.317962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.318071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.318169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.318330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.318468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.318557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.318631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] publish_errors = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] publish_errors = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.319975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] standard_threads = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] standard_threads = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.320880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] use_journal = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_journal = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] use_json = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_json = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] use_stderr = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_stderr = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] use_syslog = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.321853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_syslog = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.322027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.322148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:03:00.322261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.322361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.322516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.322638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.322751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.322846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.323954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.324981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.325923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.326941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.327973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.328953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.329882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.330984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.331964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.332952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.333930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.334895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.335998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.336948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337732 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.337960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.338960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.339957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.340846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.341940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342156 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.342841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.343949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.344998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.345992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.external = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.external = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.346892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.password = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] auth.token = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.password = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.token = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.347945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.348948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.349949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.350944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.351951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.352958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.353929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.354921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.355940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.356888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.357903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.358863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.359970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.360966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.361967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.362969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.363936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.364961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.365975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.366987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.367979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.368888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.369926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.370966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.371913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.372949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.373964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.374960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.375911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.376934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.377946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] role.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] role.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.378937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.379942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.380907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.381986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.382929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.383992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.384895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.385889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.386890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.387962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.388933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.389984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.390123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.390237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.390356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.390465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.390947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.connection = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.391911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.392990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.393999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.394952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.395060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.395169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.395286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.395397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.395506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:03:00.395621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:03:00.395731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:03:00.426025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.426255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.426342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.426476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.426559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.426698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.435029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.435381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.463000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.463202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.463297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.463544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.514603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.514889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.564554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.564777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.565173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.565411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.628453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.628683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.628932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.629976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.630180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.630408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.652573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.652784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.652889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.653938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.654066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.665028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.665373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.677310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.677562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.677725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.677865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.677946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.678848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:03:00.697411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.697555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.697692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:03:00.697815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:03:00.697960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.698176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.698300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:03:00.698433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:03:00.698514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.698577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.698665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.698866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.698991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.699059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.699135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.699306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.710921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.711058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.718876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.719195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.722129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.722413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.722536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.722665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.722748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.722937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.723854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.724895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.725020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.725234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.751438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.751556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.752751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.753032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.753214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.753527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.758224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.758498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.758774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.758899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.759057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.759317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.766372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.766596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.766947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.767228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.771032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.771428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.771705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.771829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.771985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.772948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.773073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.773206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.773472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.773740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.791439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.791714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.792282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.792631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.796407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.797331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.800018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.800311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.800983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.801279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.805384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.806471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.808955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.810093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.812801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.813094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.813393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.813671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.813925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.814145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.814233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.814352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.814554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.814782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.815075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.815353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.833060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.833334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.833595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.833852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.834330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.834617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.834884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.835142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.841792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.843211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.843495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.843749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.844959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.845229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.846812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.847089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.847367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.847640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.847911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.848278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.848557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.848865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.849142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.849413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.861434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.861709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.861981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.862261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.862536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.862803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.862929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.863065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.863144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.863336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.863623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.863904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.864183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.864454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.881064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.882537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.884295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.885864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.887575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.889177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.889323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.891150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.891278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.891413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.891700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.892805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.893093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.893370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.899039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.900638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.900761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.902361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.904009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.904294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.904573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.904870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.905736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.906027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.906276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.906581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.913906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.914189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.914570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.915667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.915952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.916331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.922436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.922713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.922988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.923251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.923548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.923760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.924072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.924263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:03:00.924358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.924486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.924698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.924825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.924961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.925901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.926022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.926172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.926303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.926611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.926885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.927143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.927405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.927637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:03:00.964146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a329249c0 pid: 80557 (default app) May 23 17:03:00.966272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a329249c0 pid: 80556 (default app) May 23 17:03:00.967365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d3bc-3075-4fea-a874-413b24543587 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:00.967652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d3bc-3075-4fea-a874-413b24543587 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:00.967929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d3bc-3075-4fea-a874-413b24543587 None None] PATH_INFO: `/v3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:00.972264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Mon May 23 17:03:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:08.878369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:08.879270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:08.879270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:08.886517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:08.893577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:08.894302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:08.894429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:08.966071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: INFO dbcounter [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] Registered counter for database keystone May 23 17:03:08.990764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG oslo_db.sqlalchemy.engines [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:03:09.001549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writer thread running {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:03:09.184520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG passlib.handlers.bcrypt [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80557) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 17:03:09.184968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG passlib.handlers.bcrypt [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80557) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 17:03:09.241749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:09.243369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:09.375760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 17:03:09.581708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:09.656080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: INFO dbcounter [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] Registered counter for database keystone May 23 17:03:09.677444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG oslo_db.sqlalchemy.engines [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80556) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:03:09.688892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writer thread running {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:03:09.809620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9155a-0128-418f-bfbe-dc855ff2c98f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:09.814761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:09.815435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:09.815720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:09.816001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:09.824972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:09.879509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 17:03:09.880076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586865-5a71-4fc6-bd4d-04b1f23e6c8b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:09.890822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Mon May 23 17:03:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:03:09.898037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:09.921943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688f7b-37e2-4fb4-979b-25e44227a403 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:09.928509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:09.929700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:09.929989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:09.930265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] PATH_INFO: `/v3/projects/549ef6c44d2245c896f7c092456b7282` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:09.932013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] RBAC: Authorizing `identity:get_project(project_id=549ef6c44d2245c896f7c092456b7282)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:10.093115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 17:03:10.093468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee7ec-5cd0-4e40-bd77-0c82bb1c3a42 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:10.098484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Mon May 23 17:03:09 2022] GET /identity/v3/projects/549ef6c44d2245c896f7c092456b7282 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:12.273985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33268f-dc9b-4a60-94d0-6f2d4e540d55 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:12.274844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33268f-dc9b-4a60-94d0-6f2d4e540d55 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:12.274844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33268f-dc9b-4a60-94d0-6f2d4e540d55 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:12.281839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:12.288443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:12.288926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:12.289047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:12.311538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:12.313087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:12.321263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 17:03:12.343840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33268f-dc9b-4a60-94d0-6f2d4e540d55 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:12.364328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33268f-dc9b-4a60-94d0-6f2d4e540d55 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:12.370633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80297da-7853-439a-ac00-ad7c15c5e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:12.371285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80297da-7853-439a-ac00-ad7c15c5e116 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:12.371572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80297da-7853-439a-ac00-ad7c15c5e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:12.371857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80297da-7853-439a-ac00-ad7c15c5e116 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:12.381089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80297da-7853-439a-ac00-ad7c15c5e116 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:12.382929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80297da-7853-439a-ac00-ad7c15c5e116 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:12.393442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Mon May 23 17:03:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:03:12.401810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:12.416368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519541d-32a6-4370-a1e3-0c8a70ce83bc None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:12.423313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e016c-00f6-4985-a983-5ea8f8535adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:12.424190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e016c-00f6-4985-a983-5ea8f8535adc admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:12.424474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e016c-00f6-4985-a983-5ea8f8535adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:12.424790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e016c-00f6-4985-a983-5ea8f8535adc admin admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:12.426357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e016c-00f6-4985-a983-5ea8f8535adc admin admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:12.428281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e016c-00f6-4985-a983-5ea8f8535adc admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:12.429898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Mon May 23 17:03:12 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:14.667656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35766-152d-4393-8ff3-97588dec5f84 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:14.668245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35766-152d-4393-8ff3-97588dec5f84 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:14.668245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35766-152d-4393-8ff3-97588dec5f84 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:14.669625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:14.675095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:14.675488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:14.675728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:14.692839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:14.694405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:14.695761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0cad-b4de-437e-a376-cf73dacbf400 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:14.696054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0cad-b4de-437e-a376-cf73dacbf400 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:14.696523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0cad-b4de-437e-a376-cf73dacbf400 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:14.697922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:14.703098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:14.703390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:14.703676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:14.743105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG passlib.handlers.bcrypt [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80556) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 17:03:14.743551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG passlib.handlers.bcrypt [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80556) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 17:03:14.773817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:14.790477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:14.792203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:14.796504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:14.821407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:14.894646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:14.907102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2cee-cb4b-4c94-9847-6da3e93131a1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:14.916469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:14.945431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:14.946163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:14.946446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:14.946697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:14.959191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:14.971016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:14.972115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:14.973541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:14.978733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:15.069705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:15.088623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a165-8a45-4d27-af78-17d7e3788c07 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.121840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.122517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.122807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.123095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.123851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:15.124147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.125009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847966d-be24-4a6d-bb6d-81377bb81310 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.125605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.127289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:15.138162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:15.144223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:15.163810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.164756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.165042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.165328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.238902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.240367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.246833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b92b82-fe22-4df7-98b3-f56c50b6bf79 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.280338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.281298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.281591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.281867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.283116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.284626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.286275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 9/16] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:15 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:15.291601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:15.305758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:15.339411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 8/17] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:03:15.345053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:15.347706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:15.391139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c81b-406f-4665-aac9-62db4d39de33 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.425747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.426557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.426847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.427126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.428337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.429871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.431478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:15.437381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:15.444437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223006f-1e2b-4cdd-90fc-8e23fb888846 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.480064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.481265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.481683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.481994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.504549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.506017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.524541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:03:15.527023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:15.527846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:15.528657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:03:15.528657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:03:15.528657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:03:15.528657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:15.528657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:03:15.534444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:15.546075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52718cdd-703e-4402-a1ac-a69f05db23b9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.580916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.581621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.581892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.582172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.583015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.domain.id=default, user.id=eef11ad96d374697895a79e0a7fd9e82) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:15.583332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.584867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fef06-0565-46ce-8737-fc3913f88fe0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.591553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1322 bytes} [Mon May 23 17:03:15 2022] GET /identity/v3/role_assignments?user.id=eef11ad96d374697895a79e0a7fd9e82&scope.domain.id=default&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:15.594104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:15.643437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3833-6fc4-48ca-b712-86026318c421 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:15.681361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:15.682076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:15.682308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:15.682586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:15.683328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:15.683639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:15.685108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9dc2f-385c-449b-bf45-f1be93604a37 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:15.704176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:18.038606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eb873-dee3-491d-a3e2-a2d42dc71a96 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.039679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eb873-dee3-491d-a3e2-a2d42dc71a96 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.040165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eb873-dee3-491d-a3e2-a2d42dc71a96 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.041856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:18.048139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c916-bdac-43d0-8772-a364dd2a92f3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.049121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c916-bdac-43d0-8772-a364dd2a92f3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.049617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c916-bdac-43d0-8772-a364dd2a92f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.078083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5a74c916-bdac-43d0-8772-a364dd2a92f3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:18.079672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5a74c916-bdac-43d0-8772-a364dd2a92f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:18.162913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:18.197155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eb873-dee3-491d-a3e2-a2d42dc71a96 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:18.270733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c6a3-7506-4312-874d-5df88d3418d8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.271377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c6a3-7506-4312-874d-5df88d3418d8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.271845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c6a3-7506-4312-874d-5df88d3418d8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.273420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:18.280579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.281161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.281653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.309632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:18.312185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:18.403633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eb873-dee3-491d-a3e2-a2d42dc71a96 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:18.418829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:18.470196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:18.471390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:18.472378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.472785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.473154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.491535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:18.500255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:18.501162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:18.501915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 13/26] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:18.507813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:18.518289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:18.527711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:18.643081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad59430-edae-4804-8044-7f27f1f960ed None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:18.705078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b277a-3dc6-44b0-8ce7-b2dee67ba8a8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:18.705260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:18.705959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.706406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.706827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.717960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:18.719681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-5f3765c8-7945-461e-81fd-19c801d3d4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:03:18.738226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:18.739069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:18.739956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:03:18.739956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:03:18.739956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:03:18.739956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:18.742093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 14/27] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:03:18.743682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91960-54d3-484e-815b-6549d3f0c1e7 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.744153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91960-54d3-484e-815b-6549d3f0c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.744338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:18.744692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91960-54d3-484e-815b-6549d3f0c1e7 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.745580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.746067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 15/28] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:18.746369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.746667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.747447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:18.747810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:18.748141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91960-54d3-484e-815b-6549d3f0c1e7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:18.753363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700668-81d3-4f87-898a-fba225f91ddf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:18.768675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 14/29] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:18.771654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.771953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.772240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.810007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:18.811573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:18.867192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:18.885244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:18.928445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91960-54d3-484e-815b-6549d3f0c1e7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:18.929188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 15/30] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:18.936627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:18.976730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:18.977413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:18.977702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:18.977983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:18.978717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:18.979028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:18.980474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658675-2e59-4938-9c0c-381450b22536 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:19.003040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 16/31] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:19.004576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e3ef-e92c-4d24-b52d-70dccc19b560 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.004912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e3ef-e92c-4d24-b52d-70dccc19b560 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.005204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e3ef-e92c-4d24-b52d-70dccc19b560 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.006538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 17/32] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:19.008876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e3ef-e92c-4d24-b52d-70dccc19b560 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:19.057829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd470-d15f-4a5d-87cf-8692e54c8626 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:19.096510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:19.097854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.098354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.098884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:19.102569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:19.104573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 16/33] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:18 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:19.105569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:19.123261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e3ef-e92c-4d24-b52d-70dccc19b560 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:19.142552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:19.147317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:19.163777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7224-5805-407b-937b-19f2e6eeaab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:19.164698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7224-5805-407b-937b-19f2e6eeaab6 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.165146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7224-5805-407b-937b-19f2e6eeaab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.165585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7224-5805-407b-937b-19f2e6eeaab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.166669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf7224-5805-407b-937b-19f2e6eeaab6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:19.168300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf7224-5805-407b-937b-19f2e6eeaab6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:19.221401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25018eca-f82f-4a1b-bc5d-ab479a51b2f1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:19.258357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:19.259356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.259788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.260212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.261289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:19.262911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:19.316298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 18/34] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 17:03:19 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:19.320713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.320713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.320713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.361940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:19.363554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:19.513627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 17/35] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:03:19 2022] POST /identity/v3/projects => generated 301 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:19.520032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:19.523312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 19/36] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:19.548346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:19.684735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:19.712872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5fa4-d377-4042-bd9c-eac09d3801cb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:19.724442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6ff74-847e-4f26-a8ca-f5e8b8f2cf7a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:19.740415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:19.773109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf9b1e-479f-4936-93cc-c3c1d9b8390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:19.774190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9b1e-479f-4936-93cc-c3c1d9b8390b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.774655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9b1e-479f-4936-93cc-c3c1d9b8390b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.774959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9b1e-479f-4936-93cc-c3c1d9b8390b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.776877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9b1e-479f-4936-93cc-c3c1d9b8390b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:19.778609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9b1e-479f-4936-93cc-c3c1d9b8390b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:19.780310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 18/37] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:19.781636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5512f-e936-4623-bf30-f735709bb05d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.781935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5512f-e936-4623-bf30-f735709bb05d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.782034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a49590-d731-42fd-a67b-17d1be341869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:19.782223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5512f-e936-4623-bf30-f735709bb05d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.783104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49590-d731-42fd-a67b-17d1be341869 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.783460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 19/38] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:19.783736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49590-d731-42fd-a67b-17d1be341869 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.784024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49590-d731-42fd-a67b-17d1be341869 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.784824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a49590-d731-42fd-a67b-17d1be341869 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:19.786404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5512f-e936-4623-bf30-f735709bb05d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:19.786635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a49590-d731-42fd-a67b-17d1be341869 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:19.811591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 17:03:19 2022] POST /identity/v3/roles => generated 225 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:03:19.813732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.814036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.814714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.842935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:19.844397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:19.941059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5512f-e936-4623-bf30-f735709bb05d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:19.943280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 21/40] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:19.968404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:19.983293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472cc77-807a-4ce4-b551-94ed1b8ad653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:19.984193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472cc77-807a-4ce4-b551-94ed1b8ad653 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:19.984477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472cc77-807a-4ce4-b551-94ed1b8ad653 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:19.984808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472cc77-807a-4ce4-b551-94ed1b8ad653 None admin] PATH_INFO: `/v3/domains/default/users/eef11ad96d374697895a79e0a7fd9e82/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:19.987000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472cc77-807a-4ce4-b551-94ed1b8ad653 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eef11ad96d374697895a79e0a7fd9e82, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:19.988508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472cc77-807a-4ce4-b551-94ed1b8ad653 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:20.009206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 20/41] 10.222.0.46 () {58 vars in 1361 bytes} [Mon May 23 17:03:19 2022] PUT /identity/v3/domains/default/users/eef11ad96d374697895a79e0a7fd9e82/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:03:20.059020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc500e3-e1aa-431c-b0bd-850e900e5bbb None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:20.059603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc500e3-e1aa-431c-b0bd-850e900e5bbb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:20.059603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc500e3-e1aa-431c-b0bd-850e900e5bbb None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:20.060929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 21/42] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:20.066537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:20.066899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:20.067197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:20.092276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:20.094640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:20.101915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:20.108530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e7a4-1958-40f1-9d26-37de18c67201 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:20.117648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:20.154383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:20.155169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:20.155443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:20.155724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:20.156503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:20.158034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:20.173279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 22/43] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 17:03:19 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:03:20.184773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 22/44] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:20.208284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:20.323249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db07d0-fc79-4e1e-90be-fa862ac007c5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:20.362071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe90f2-dcae-46ac-9cfb-9c7032703dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:20.362887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe90f2-dcae-46ac-9cfb-9c7032703dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:20.363176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe90f2-dcae-46ac-9cfb-9c7032703dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:20.363454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe90f2-dcae-46ac-9cfb-9c7032703dc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:20.365384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe90f2-dcae-46ac-9cfb-9c7032703dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:20.367223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe90f2-dcae-46ac-9cfb-9c7032703dc6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:20.368962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 23/45] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:20.374566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:20.485917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5a804-b903-4024-b6fb-66a013ad0c58 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:20.521847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9a15c-6f77-4c69-bf3c-4d8ce5bff1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:20.522539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9a15c-6f77-4c69-bf3c-4d8ce5bff1dc None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:20.522832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9a15c-6f77-4c69-bf3c-4d8ce5bff1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:20.523095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9a15c-6f77-4c69-bf3c-4d8ce5bff1dc None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:20.523856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9a15c-6f77-4c69-bf3c-4d8ce5bff1dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:20.525392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9a15c-6f77-4c69-bf3c-4d8ce5bff1dc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:20.546339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:20.553608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:03:20 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:22.240991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869dbf-27ad-49ed-bd3f-e19c426283a2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.241530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869dbf-27ad-49ed-bd3f-e19c426283a2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.241530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869dbf-27ad-49ed-bd3f-e19c426283a2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.242931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 24/47] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:22.248294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328599-c937-4048-803b-9fed16b06209 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.248908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328599-c937-4048-803b-9fed16b06209 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.248908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328599-c937-4048-803b-9fed16b06209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.266476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e4328599-c937-4048-803b-9fed16b06209 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:22.267704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e4328599-c937-4048-803b-9fed16b06209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:22.335827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:22.358650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869dbf-27ad-49ed-bd3f-e19c426283a2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:22.384886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:22.462312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869dbf-27ad-49ed-bd3f-e19c426283a2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:22.496214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:22.496966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.497249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.497526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.508059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:22.516052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:22.516936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:22.517706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 25/49] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:22.523204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328599-c937-4048-803b-9fed16b06209 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:22.628328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328599-c937-4048-803b-9fed16b06209 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:22.655402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:22.664497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:22.665217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.665507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.665783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.666546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:22.666865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:22.668265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce246b8-a3cc-4b3e-a04c-e3cc092616c5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:22.676491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 25/50] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:22.682210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:22.739853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4849-3d2c-4865-b8b7-979026d6430e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.740153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4849-3d2c-4865-b8b7-979026d6430e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.740436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4849-3d2c-4865-b8b7-979026d6430e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.741857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 26/51] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:22.748027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.748255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.750404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.768488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:22.769752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:22.773442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:22.795128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d54dd2-6f58-4fcd-a085-e8ab9daafc1a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:22.829860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:22.830745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.831033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.831311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.832493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:22.834027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:22.835690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 26/52] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:22 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:22.841082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:22.842080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:22.864923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:22.939850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb41ba-3e0c-4269-9911-f02ee05fc4f8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:22.965018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642310d8-e524-4a0d-abce-175c4247b9c4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:22.972593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:22.973417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:22.973703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:22.973983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:22.975160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:22.976715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:22.978359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 27/54] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:22.984132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:22.985287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:23.000119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:23.000946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:23.001236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:23.001509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:23.002715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:23.004198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:23.005898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:23.006327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:23.011437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:23.086204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639f119-6748-4343-9e07-339ba4e7b517 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:23.108889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037772-30c8-46e6-a433-20dfe3e7c7e2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:23.118621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:23.119280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:23.119567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:23.119855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:23.120720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.domain.id=default, user.id=eef11ad96d374697895a79e0a7fd9e82) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:23.121037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:23.122534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf70026-6a64-4a68-955a-58f79fc375db None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:23.128322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 28/56] 10.222.0.46 () {56 vars in 1322 bytes} [Mon May 23 17:03:22 2022] GET /identity/v3/role_assignments?user.id=eef11ad96d374697895a79e0a7fd9e82&scope.domain.id=default&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:23.143120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90d4c-4ea5-415d-b03e-11ba3c3ff45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:23.143818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90d4c-4ea5-415d-b03e-11ba3c3ff45f None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:23.144107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90d4c-4ea5-415d-b03e-11ba3c3ff45f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:23.144390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90d4c-4ea5-415d-b03e-11ba3c3ff45f None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:23.145170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90d4c-4ea5-415d-b03e-11ba3c3ff45f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:23.146682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90d4c-4ea5-415d-b03e-11ba3c3ff45f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:23.174874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 29/57] 10.222.0.46 () {60 vars in 1140 bytes} [Mon May 23 17:03:23 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:25.342509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706c969-f764-412c-b0e4-16b7f23d72d4 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.343381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706c969-f764-412c-b0e4-16b7f23d72d4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.343381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706c969-f764-412c-b0e4-16b7f23d72d4 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.345670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 29/58] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:25.352010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.352443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.352659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.378144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:25.379367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:25.416235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:25.453376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:25.477775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706c969-f764-412c-b0e4-16b7f23d72d4 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:25.571188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:25.588246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706c969-f764-412c-b0e4-16b7f23d72d4 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:25.621658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130f1ac-9b26-43fc-ac4c-e55da0109c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:25.622387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130f1ac-9b26-43fc-ac4c-e55da0109c0a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.622672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130f1ac-9b26-43fc-ac4c-e55da0109c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.622952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130f1ac-9b26-43fc-ac4c-e55da0109c0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.624197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130f1ac-9b26-43fc-ac4c-e55da0109c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:25.625718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130f1ac-9b26-43fc-ac4c-e55da0109c0a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:25.627510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 30/60] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:25.633109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:25.735155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb76ce-79d2-4bcc-9979-7a1d37f77fd1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:25.770293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788f42-cb0b-4e3a-8c97-abb2555e0969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:25.770980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788f42-cb0b-4e3a-8c97-abb2555e0969 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.771270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788f42-cb0b-4e3a-8c97-abb2555e0969 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.771545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788f42-cb0b-4e3a-8c97-abb2555e0969 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.772276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788f42-cb0b-4e3a-8c97-abb2555e0969 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:25.773811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788f42-cb0b-4e3a-8c97-abb2555e0969 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:25.805295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:25 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:29.176797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ee875-5599-416a-84a0-2f5f4f84030a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.177875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ee875-5599-416a-84a0-2f5f4f84030a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.178363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ee875-5599-416a-84a0-2f5f4f84030a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.180079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 31/62] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:29.186634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb09e-c43a-4383-ae6a-a7ca5094c76f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.187590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb09e-c43a-4383-ae6a-a7ca5094c76f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.188066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb09e-c43a-4383-ae6a-a7ca5094c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.209019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a97bb09e-c43a-4383-ae6a-a7ca5094c76f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:29.210557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a97bb09e-c43a-4383-ae6a-a7ca5094c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:29.240147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:29.302769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 32/63] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:29.341635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ee875-5599-416a-84a0-2f5f4f84030a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:29.353064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435f01-279b-4450-9616-9d904d22e76f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.353357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435f01-279b-4450-9616-9d904d22e76f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.353645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435f01-279b-4450-9616-9d904d22e76f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.360546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 33/64] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:29.361795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25ee4-f5eb-4256-9328-1543f4d5fb1b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.362087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25ee4-f5eb-4256-9328-1543f4d5fb1b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.362369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25ee4-f5eb-4256-9328-1543f4d5fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.397679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6fd25ee4-f5eb-4256-9328-1543f4d5fb1b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:29.398925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6fd25ee4-f5eb-4256-9328-1543f4d5fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:29.470405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ee875-5599-416a-84a0-2f5f4f84030a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:29.492395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 34/65] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:29.494209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85e9d-2d07-4096-8dd2-2e947cd17db9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.494774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85e9d-2d07-4096-8dd2-2e947cd17db9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.495409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85e9d-2d07-4096-8dd2-2e947cd17db9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.496967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 35/66] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:29.502404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.502933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.503471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.521888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:29.522977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.523404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.523859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.528121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:29.530148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:29.536046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:29.544263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:29.545154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:29.545991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:29.548332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 32/67] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:29.549350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:29.567494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:29.640771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 36/68] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:29.640771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:29.666464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:29.685735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf96b2-98fe-42fc-b145-8625be64d31e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:29.719913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a852e43-be96-4d42-9bfe-2bca7ca392d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:29.720938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852e43-be96-4d42-9bfe-2bca7ca392d1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.721237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852e43-be96-4d42-9bfe-2bca7ca392d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.721582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852e43-be96-4d42-9bfe-2bca7ca392d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.733561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a852e43-be96-4d42-9bfe-2bca7ca392d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-7a852e43-be96-4d42-9bfe-2bca7ca392d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:29.741273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:29.742124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:29.742887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 33/69] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:29.743704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80059-1b92-46d8-8ebc-f3afc5126b4c None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.744137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80059-1b92-46d8-8ebc-f3afc5126b4c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.744553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80059-1b92-46d8-8ebc-f3afc5126b4c None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.748716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 34/70] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:29.748716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80059-1b92-46d8-8ebc-f3afc5126b4c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:29.753639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd0c3-3efb-40b4-81bb-6ca43c3e899e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:29.798068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:29.798837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.799046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.799363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.800099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:29.800410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:29.801911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:29.811312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 37/71] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:29.812128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:29.828546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:29.859873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80059-1b92-46d8-8ebc-f3afc5126b4c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:29.889350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:29.894058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519155-7e1f-4609-a564-037e70a67546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:29.894863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519155-7e1f-4609-a564-037e70a67546 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.895147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519155-7e1f-4609-a564-037e70a67546 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.895422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519155-7e1f-4609-a564-037e70a67546 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.905878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519155-7e1f-4609-a564-037e70a67546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:29.911321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca076627-69f0-4d29-b289-2f06323ece47 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-95519155-7e1f-4609-a564-037e70a67546 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:29.913932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:29.914962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:29.915761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 35/72] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:03:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:29.916464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.916676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.916856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.932922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:29.934105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:29.947622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381a705-6493-4b03-9284-1d684699142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:29.948262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a705-6493-4b03-9284-1d684699142c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.948575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a705-6493-4b03-9284-1d684699142c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.948888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a705-6493-4b03-9284-1d684699142c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.949643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381a705-6493-4b03-9284-1d684699142c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:29.949958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381a705-6493-4b03-9284-1d684699142c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:29.951331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381a705-6493-4b03-9284-1d684699142c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:29.959434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 38/73] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:29.960455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ad1e5-c95f-4da8-8da1-0d034d45b320 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:29.960777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ad1e5-c95f-4da8-8da1-0d034d45b320 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:29.961053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ad1e5-c95f-4da8-8da1-0d034d45b320 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:29.962257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 39/74] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:29.965243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ad1e5-c95f-4da8-8da1-0d034d45b320 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.006144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 36/75] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:30.007298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.070111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ad1e5-c95f-4da8-8da1-0d034d45b320 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.070710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.104612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.105652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.105946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.106228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.112394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c7a9-6347-4521-8b28-824c43f97683 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.116536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.122282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.123896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.125745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 40/76] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:29 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:30.126534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.150399 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.151218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.151501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.151776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.152540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:30.152880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.154281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7e271-b119-4445-b8cc-80cc9d9086a3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.162491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 37/77] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:30.163656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.163965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.164248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.180142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:30.181361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:30.231557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357c82-2fb3-4fc4-8d67-bdcc63f9c518 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.246298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 38/78] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:30.252428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.267173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.268344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.268632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.268967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.270584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.272315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.274390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 41/79] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:30.275429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.306371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.340440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.350037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554973-d720-4f53-8369-2fde4744cad2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.373244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a6c97-c8ea-4751-8e6b-19adb81cffed None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.383604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.384404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.384721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.384986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.395465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:30.403146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:30.404047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:30.404851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 39/80] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:30.405502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.411026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.411695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.411982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.412264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.478355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.479855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.504610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99a0e2-c189-47e6-8dbc-692df139533a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.518188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.538285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.539158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.539438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.539705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.540910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.541971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.542652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.544094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 40/81] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:30.544864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.579926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 42/82] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:30.580824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.644320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695383-bbc5-45a5-8e91-06e4511ddeb7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.676846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.677641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.677924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.678206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.679333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.680005 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ce45-518c-4b25-a4ef-495b57042a22 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.680838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.682423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 41/83] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:30.687185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.714339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.715016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.715284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.715560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.731249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.749904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.780640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe366a-4d6b-4513-9266-8d3745e4b68b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.786817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.788329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.817966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.818627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.818925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.819212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.819956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:30.820265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:30.821693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:30.829979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 42/84] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:30.831675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.889595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 43/85] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:30.890292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:30.930439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59461d9-01b1-4f2e-b22b-96ceb75042d7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:30.942956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.953892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:30.965505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:30.966162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:30.966457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:30.966736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:30.987876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cad66-3c71-4480-b4bd-3faa8713e755 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.023370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.024417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.024762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.025038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.026274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.027769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.029533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 44/86] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:31.030282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.035864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.037357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.130249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be1768-ceb9-4c2b-aa91-dbceaf6c1bb6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.135440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 43/87] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:31.136273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.151927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:31.164297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.165036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.165332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.165622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.166348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.167959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.174603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:31.188165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 45/88] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:31 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:31.200773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.247163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e69d7-a37f-46ce-9bb9-a99b12d69217 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.284485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.285419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.285708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.286042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.287261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.288835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.290589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 44/89] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:31.291403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.304260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4adb7-22f9-46cc-9980-18b524a26a64 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.344986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.345894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.346186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.346467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.347756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.349282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.356096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 46/90] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:31.356096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.390919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:31.419906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7746c0c-bf92-456c-a4be-f9df63e7c979 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.424263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:31.469095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.470091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.470559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.471007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.472043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=6a828f4d2cba4ce2bf3d1520397c11ec) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:31.472528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.474253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.475817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240a3c-c1dc-472a-9aa7-ea18d2e446df None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.483252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 45/91] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/role_assignments?user.id=6a828f4d2cba4ce2bf3d1520397c11ec&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=c1a812e032604c4683295a602c263e78 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:31.484106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.531109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.532319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.532575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.532889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.534312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.535955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.538218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 47/92] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:31.539103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.650947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1ef9-fb5f-4a01-95ae-7644e927bfa1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.683764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07a4e5-771a-46b7-822c-9d66d9b2a089 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:31.715379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:31.724040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.725025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.725771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.726060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.726923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=eef11ad96d374697895a79e0a7fd9e82) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:31.727311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.729159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:31.741513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 48/93] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/role_assignments?user.id=eef11ad96d374697895a79e0a7fd9e82&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:31.742376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:31.746874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:31.747566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:31.747858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:31.748140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:31.774977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:31.848986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:31.850768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:32.020367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a84d7e-7606-448c-8289-34c1725d5860 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:32.087227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:32.087818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:32.088109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:32.088390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:32.089264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] RBAC: Adding query filter params (role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=6a828f4d2cba4ce2bf3d1520397c11ec) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:32.089580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:32.090431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 46/94] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:32.095822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:32.100329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:32.108271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 49/95] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:31 2022] GET /identity/v3/role_assignments?user.id=6a828f4d2cba4ce2bf3d1520397c11ec&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:32.189366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:32.261650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed94a2-4ea8-429f-a8c9-21a574359307 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:32.306252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e3fb3-34bf-42c1-a1d3-c90490f43aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:32.308722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e3fb3-34bf-42c1-a1d3-c90490f43aaa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:32.308722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e3fb3-34bf-42c1-a1d3-c90490f43aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:32.308722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e3fb3-34bf-42c1-a1d3-c90490f43aaa None admin] PATH_INFO: `/v3/projects/2952afdc03a244c592a21a64ee467575` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:32.308993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e3fb3-34bf-42c1-a1d3-c90490f43aaa None admin] RBAC: Authorizing `identity:get_project(project_id=2952afdc03a244c592a21a64ee467575)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:32.312637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e3fb3-34bf-42c1-a1d3-c90490f43aaa None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:32.317714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 47/96] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:32 2022] GET /identity/v3/projects/2952afdc03a244c592a21a64ee467575 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:32.325753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:32.429776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:32.496689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b645f6-8fee-4336-9a97-8f2b97aa4afd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:32.547222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:32.548218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:32.548698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:32.549273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:32.550289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, scope.project.id=2952afdc03a244c592a21a64ee467575, user.id=6a828f4d2cba4ce2bf3d1520397c11ec) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:32.550773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:32.552417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882a512-2e02-4f39-8ee8-74e1da9bef89 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:32.560714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 50/97] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:32 2022] GET /identity/v3/role_assignments?user.id=6a828f4d2cba4ce2bf3d1520397c11ec&scope.project.id=2952afdc03a244c592a21a64ee467575&role.id=c1a812e032604c4683295a602c263e78 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:33.995125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ed05-1f1c-4be2-a457-de91c49e6c17 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:33.996184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ed05-1f1c-4be2-a457-de91c49e6c17 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:33.996713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ed05-1f1c-4be2-a457-de91c49e6c17 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:33.998338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 48/98] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:34.003904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.004813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.005330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.022845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:34.024381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:34.099352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 51/99] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:34.124130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ed05-1f1c-4be2-a457-de91c49e6c17 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:34.245694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ed05-1f1c-4be2-a457-de91c49e6c17 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:34.271232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:34.294063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:34.294947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.295278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.295560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.310109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:34.318166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:34.319077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:34.320273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 49/100] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:34.325454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:34.386662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:34.452301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc893bd-f53d-4ca0-989b-7cb6899b4658 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:34.486730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:34.487449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.487738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.488020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.488822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:34.489139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:34.490570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:34.499657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 52/101] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:34.505221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:34.630864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93fe4-0b44-44b8-98e7-90dbc3152f64 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:34.672169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af0630-a98a-4694-844e-f6861c72c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:34.673091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0630-a98a-4694-844e-f6861c72c424 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.673375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0630-a98a-4694-844e-f6861c72c424 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.673654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0630-a98a-4694-844e-f6861c72c424 None admin] PATH_INFO: `/v3/users/9aed0761ce524285be213bcc811e2bab` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.699278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af0630-a98a-4694-844e-f6861c72c424 None admin] RBAC: Authorizing `identity:get_user(user_id=9aed0761ce524285be213bcc811e2bab)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:34.700892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af0630-a98a-4694-844e-f6861c72c424 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:34.702710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 50/102] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:34 2022] GET /identity/v3/users/9aed0761ce524285be213bcc811e2bab => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:34.708416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:34.789707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623b67-41fe-4ca6-a968-ecd18f50f1f9 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.789707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623b67-41fe-4ca6-a968-ecd18f50f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.789707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623b67-41fe-4ca6-a968-ecd18f50f1f9 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.789707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 51/103] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:34.799081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474290eb-712f-4a61-bcab-a4382d74ccdf None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.799605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474290eb-712f-4a61-bcab-a4382d74ccdf None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.800091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474290eb-712f-4a61-bcab-a4382d74ccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.824969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-474290eb-712f-4a61-bcab-a4382d74ccdf None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:34.831253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-474290eb-712f-4a61-bcab-a4382d74ccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:34.861567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:34.931845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 52/104] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:34.934126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6829d89-647e-4756-9f9b-28e7de40411b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:34.952041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade0d9-b4c2-40e2-a0f8-b19d8238a83a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.952710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade0d9-b4c2-40e2-a0f8-b19d8238a83a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.953201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade0d9-b4c2-40e2-a0f8-b19d8238a83a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.955064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 53/105] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:34.956358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201bcc-7bf8-44f6-8d9c-f96946e7d74a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.956674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201bcc-7bf8-44f6-8d9c-f96946e7d74a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.957174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201bcc-7bf8-44f6-8d9c-f96946e7d74a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.958555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 54/106] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:34.964298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f08197-e3da-49da-bd15-292bcc8733da None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.964958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f08197-e3da-49da-bd15-292bcc8733da None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.965089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:34.965273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f08197-e3da-49da-bd15-292bcc8733da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.985140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:34.986247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:34.986736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:34.987248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:34.990016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-78f08197-e3da-49da-bd15-292bcc8733da None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:34.991372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-78f08197-e3da-49da-bd15-292bcc8733da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:35.056100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.058271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.068932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 55/107] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:35.070671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.070842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.071231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.102782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:35.104076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:35.159882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 53/108] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:35.165402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.180936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 56/109] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:35.181919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.188963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.219631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.266363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998045b-0410-40ee-b9cf-bb8ef42f29ce None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.300538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.301702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.302138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.302559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.302775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebf803-2be0-4bbd-8f0a-e901232a9646 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.314523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:35.323883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:35.324790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:35.325573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:35.328113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 54/110] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:35.329116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.339288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.340160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.340386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.340710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.341902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.343449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.349816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 57/111] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:35.350696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.404049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.437462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90fb2-570a-4c7b-8354-45348bf7fd09 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.441108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.456474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5b3df-3ff7-4387-bc19-9e693403cc82 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.476550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.477848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.478339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.478845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.480314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.482134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.484228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 55/112] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:35.485257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.494194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.495008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.495296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.495573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.506721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:35.514591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:35.515776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:35.516523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:35.520746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 58/113] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:35.521777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.598174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601967b-36c4-4c7b-b075-fcd84e475e67 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.628532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33dbd-bea4-41f4-a40a-030d955c58eb None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.633098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.634046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.634584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.635072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.636044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:35.636554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.638163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.644286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.650180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 56/114] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:35.651352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.663920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.664592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.664902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.665234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.666061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.667790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.692868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.704899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 59/115] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:03:35 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:35.706169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.757041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61792b1b-722d-45f0-8038-67f6590ad857 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.805564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.806260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.806553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.806838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.807710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] RBAC: Adding query filter params (role.id=32158fa17dd24a27aa60e7f3a9fb806d, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=9aed0761ce524285be213bcc811e2bab) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:35.808031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.809578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77522f-4a1c-456d-a040-9d4be91d1144 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.815711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 57/116] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/role_assignments?user.id=9aed0761ce524285be213bcc811e2bab&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=32158fa17dd24a27aa60e7f3a9fb806d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:35.817084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840f862-cdce-4dca-8204-ea78b1d81a5a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.817372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840f862-cdce-4dca-8204-ea78b1d81a5a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.817651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840f862-cdce-4dca-8204-ea78b1d81a5a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.823352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 58/117] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:35.823352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840f862-cdce-4dca-8204-ea78b1d81a5a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:35.838158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049817-cd33-4987-8d33-0013b0c03686 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:35.891024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:35.892047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.892512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.893008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.893982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:35.894464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:35.896418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281598dd-003f-4965-a666-4b076e7f4335 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:35.910910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 60/118] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:35.912789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1e68-dacc-4f23-9e4a-e820e9842e73 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.913291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1e68-dacc-4f23-9e4a-e820e9842e73 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.913727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1e68-dacc-4f23-9e4a-e820e9842e73 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.915275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 61/119] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:35.916644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802a50-7a4c-40c1-8222-196fefc3d665 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:35.917106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802a50-7a4c-40c1-8222-196fefc3d665 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:35.917642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802a50-7a4c-40c1-8222-196fefc3d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:35.919271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:35.936233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-55802a50-7a4c-40c1-8222-196fefc3d665 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:35.937489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-55802a50-7a4c-40c1-8222-196fefc3d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:35.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840f862-cdce-4dca-8204-ea78b1d81a5a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.016463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.017540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.017924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.018261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.018938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.020356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.022233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.024174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 59/120] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:35 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:36.025672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.031695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 62/121] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:36.033060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.033351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.033631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.051271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:36.052553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:36.122243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 63/122] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:36.123114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.151472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471571-3838-4149-9ec3-2b64444edee5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.183820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.189833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.191202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.191642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.191989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.193405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.195084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.197086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 60/123] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:36.197947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.250264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a684e-6f38-45d3-bf7f-335be0c61b92 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.275124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.287717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.289334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.289334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.289334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.290451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.291930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.293836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 64/124] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:36.294432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.321106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5c97-826e-4192-a819-608b4981bfec None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.357161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.358459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.358954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.359448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.370156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:36.378750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:36.379629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:36.380386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:36.382768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 61/125] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:36.383779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.397544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b182d9-ed51-4e46-b507-5301a84f1241 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.431363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.432170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.432454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.432828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.442995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:36.450729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:36.451687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:36.452455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 65/126] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:36.453137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.456975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.498850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a270676-06e2-415c-b0d0-2adbc85b4048 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.503413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.540323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.541597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.542110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.542610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.544284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.546080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.548129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 62/127] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:36.549424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.559327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0d794-ff92-4620-b11e-bfb25e0508c3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.601051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.602354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.602354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.603099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/6a828f4d2cba4ce2bf3d1520397c11ec/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.604468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c98dfc42b44f5f9c98f1717152a2dd, user_id=6a828f4d2cba4ce2bf3d1520397c11ec, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.606519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.625184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 66/128] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:36 2022] PUT /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/6a828f4d2cba4ce2bf3d1520397c11ec/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:36.625830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.689477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db1a52-6b1d-4d64-93dd-a0f0a974b5bd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.762905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.780704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ec051-f70a-404f-9c8e-d26d5e2029ab None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.789425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.790147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.790445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.790731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.791603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:36.791974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.797618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.798092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.825302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:36.826036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:36.826479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:36.826724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 63/129] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:36.826830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:36.827496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:36.827672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.827875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:36.834118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:36.844256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 67/130] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:36.844984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:36.968341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2916e-13fa-485d-a686-5f0fe9e13f0c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:36.978340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a671c-3536-4777-b5ab-9093488518eb None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:37.004416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.005491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.005785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.006069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/eef11ad96d374697895a79e0a7fd9e82/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.008359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c98dfc42b44f5f9c98f1717152a2dd, user_id=eef11ad96d374697895a79e0a7fd9e82, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.012225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.025332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.026543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.029387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.030730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.036004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 64/131] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:36 2022] PUT /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/eef11ad96d374697895a79e0a7fd9e82/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:37.036651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.037671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:37.041097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.044421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 68/132] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:36 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:37.057033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:37.110015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:37.170395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:37.204389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f4c-9352-4456-ba5f-6161499b868a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:37.272666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.273600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.273896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.274178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.281629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.283555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.286291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 69/133] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:37 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:37.292748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0798-76bc-4869-b312-0bf4b01a4204 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:37.297101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:37.363746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.364679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.364978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.365265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.370659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.372150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.374495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 65/134] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:37 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:37.381149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:37.512276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015bfd-8471-47b4-9bf0-9abaee29f152 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:37.525866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:37.549345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.558192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.558514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.558813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/6a828f4d2cba4ce2bf3d1520397c11ec/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.562912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c98dfc42b44f5f9c98f1717152a2dd, user_id=6a828f4d2cba4ce2bf3d1520397c11ec, role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.564422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.586505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 70/135] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:37 2022] PUT /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/6a828f4d2cba4ce2bf3d1520397c11ec/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:37.644006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bbae-9989-43d8-9922-12cad4b2ef01 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:37.662594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:37.684561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9f38-d31d-4ae4-9474-fe1a6a0c6ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.685493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9f38-d31d-4ae4-9474-fe1a6a0c6ebf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.685813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9f38-d31d-4ae4-9474-fe1a6a0c6ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.686096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9f38-d31d-4ae4-9474-fe1a6a0c6ebf None admin] PATH_INFO: `/v3/projects/2952afdc03a244c592a21a64ee467575` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.687346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9f38-d31d-4ae4-9474-fe1a6a0c6ebf None admin] RBAC: Authorizing `identity:get_project(project_id=2952afdc03a244c592a21a64ee467575)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.688923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9f38-d31d-4ae4-9474-fe1a6a0c6ebf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.690668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 66/136] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:37 2022] GET /identity/v3/projects/2952afdc03a244c592a21a64ee467575 => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:37.696384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:37.834779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f92bf-c157-4a76-862e-c3dc008134cf None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:37.884439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069fb6a-ab9f-4a3d-8a98-e4489d64d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:37.885388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069fb6a-ab9f-4a3d-8a98-e4489d64d20a None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:37.885677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069fb6a-ab9f-4a3d-8a98-e4489d64d20a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:37.885955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069fb6a-ab9f-4a3d-8a98-e4489d64d20a None admin] PATH_INFO: `/v3/projects/2952afdc03a244c592a21a64ee467575/users/6a828f4d2cba4ce2bf3d1520397c11ec/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:37.888025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069fb6a-ab9f-4a3d-8a98-e4489d64d20a None admin] RBAC: Authorizing `identity:create_grant(project_id=2952afdc03a244c592a21a64ee467575, user_id=6a828f4d2cba4ce2bf3d1520397c11ec, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:37.889694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069fb6a-ab9f-4a3d-8a98-e4489d64d20a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:37.910924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 71/137] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:37 2022] PUT /identity/v3/projects/2952afdc03a244c592a21a64ee467575/users/6a828f4d2cba4ce2bf3d1520397c11ec/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:03:38.519141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59046e81-c5a1-45fa-b69a-56f1430e643f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:38.519650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59046e81-c5a1-45fa-b69a-56f1430e643f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:38.519724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59046e81-c5a1-45fa-b69a-56f1430e643f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:38.521117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 67/138] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:38.534959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:38.535551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:38.535551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:38.557609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:38.558814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:38.584083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a918-3d00-4b26-9034-7711ec52bba7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:38.584373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a918-3d00-4b26-9034-7711ec52bba7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:38.584675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a918-3d00-4b26-9034-7711ec52bba7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:38.586042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 68/139] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:38.591052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:38.602417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:38.602720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:38.603011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:38.629667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:38.630867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:38.636559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 72/140] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:38.669053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:38.750456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 69/141] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:38.794190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:38.858452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac43341-085f-4487-b6a9-c1acf5521345 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:38.909292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:38.910822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:38.911286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:38.911875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:38.913378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:38.915314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:38.919429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 73/142] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:38.932061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:38.972693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:38.991026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b4a6b-dd37-456a-bef6-dcfbe26119da None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:39.023939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:39.061146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:39.061888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:39.062177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:39.062457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:39.083462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:39.092378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:39.093228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:39.093991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:39.096010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 70/143] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:03:39.100342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:39.107394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d8448-7707-45dd-98f0-c69f3100d9f1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:39.172544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:39.174113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:39.174409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:39.174689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:39.175428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:39.176935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:39.215337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 74/144] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:38 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:39.270087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1790ab-9148-4e33-a3f4-47910f3bda51 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:39.308893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:39.309641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:39.309939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:39.310226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:39.311035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:39.311408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:39.312814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:39.322900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 71/145] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:39.329059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:39.433319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:39.455964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d97ab4-94fe-4689-8fd0-a047d616010e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:39.502046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:39.502948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:39.503235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:39.503515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] PATH_INFO: `/v3/users/9aed0761ce524285be213bcc811e2bab` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:39.505299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] RBAC: Authorizing `identity:get_user(user_id=9aed0761ce524285be213bcc811e2bab)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:39.506856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:39.508561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 75/146] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:39 2022] GET /identity/v3/users/9aed0761ce524285be213bcc811e2bab => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:39.514329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:39.567103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:39.644702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30272-28f6-482d-af60-ca80cdf0369c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:39.684617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81f00-76a2-4299-a4b5-e1525c18d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:39.685536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81f00-76a2-4299-a4b5-e1525c18d046 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:39.685888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81f00-76a2-4299-a4b5-e1525c18d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:39.686177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81f00-76a2-4299-a4b5-e1525c18d046 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:39.693360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81f00-76a2-4299-a4b5-e1525c18d046 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:39.694862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81f00-76a2-4299-a4b5-e1525c18d046 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:39.696975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 72/147] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:39 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:39.702755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:39.920454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cfb46-aa18-4b3a-8dac-094eb54c1eee None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:39.982890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:39.983805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:39.984088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:39.984362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/9aed0761ce524285be213bcc811e2bab/roles/32158fa17dd24a27aa60e7f3a9fb806d` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:39.989898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c98dfc42b44f5f9c98f1717152a2dd, user_id=9aed0761ce524285be213bcc811e2bab, role_id=32158fa17dd24a27aa60e7f3a9fb806d)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:39.991401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:40.005928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd3317-d8b6-4b5f-ab97-dd7de6df6536 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.006548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd3317-d8b6-4b5f-ab97-dd7de6df6536 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.007022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd3317-d8b6-4b5f-ab97-dd7de6df6536 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.008790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 73/148] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:40.014464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c665-a60b-46b3-bfb8-134b5788f861 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.015055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c665-a60b-46b3-bfb8-134b5788f861 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.015860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c665-a60b-46b3-bfb8-134b5788f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.015960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 76/149] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:39 2022] PUT /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/users/9aed0761ce524285be213bcc811e2bab/roles/32158fa17dd24a27aa60e7f3a9fb806d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:40.057853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b243c665-a60b-46b3-bfb8-134b5788f861 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:40.059460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b243c665-a60b-46b3-bfb8-134b5788f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:40.139699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 74/150] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:40.178246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:40.195992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:40.276435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9200-4a38-4379-836d-bfa6dc85e5f7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.277109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9200-4a38-4379-836d-bfa6dc85e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.277582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9200-4a38-4379-836d-bfa6dc85e5f7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.279178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 75/151] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:40.289126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.289716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.290199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.321483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:40.323801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:40.329207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a8a5-dc17-401b-9382-b0d4107f5cc4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:40.375803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:40.391377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:40.392534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.393119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.393602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.408752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:40.418321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:40.419208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:40.419963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:40.422419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 76/152] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:40.422821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 77/153] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:40.428312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:40.495506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:40.550715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0033187-8825-4e60-8093-ebd125866e53 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:40.591224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:40.592051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.592237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.592519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.593310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:40.593620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:40.595526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:40.605497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 77/154] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:40.617668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:40.657821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:40.686117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:40.728579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cc18-da36-4912-92c2-6defeeb6f2fa None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:40.821134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:40.822009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.822293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.822623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.848178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:40.862447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55fcc9-7c1b-4bee-80ef-771e5430efbc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:40.865387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:40.866233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:40.867152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 78/155] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:03:40.874244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:40.916801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:40.918256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:40.918545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:40.918825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] PATH_INFO: `/v3/users/eef11ad96d374697895a79e0a7fd9e82` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:40.920192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] RBAC: Authorizing `identity:get_user(user_id=eef11ad96d374697895a79e0a7fd9e82)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:40.922357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:40.924051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 78/156] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:40 2022] GET /identity/v3/users/eef11ad96d374697895a79e0a7fd9e82 => generated 247 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:40.931669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.032235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d16811-e766-4721-8274-f78ef01d3699 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.098743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.099432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.099718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.099994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.100806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:41.101116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:41.102524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:41.104904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.112246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 79/157] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:41.117732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.141885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.162852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46c7d-0de8-48e5-a223-66cb252802be None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.225467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1575e-9b75-4232-b6aa-e296e0d82428 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.260884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.261327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffef120-21e3-4be6-ab9c-a419d66d3bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.261776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.262005 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef120-21e3-4be6-ab9c-a419d66d3bec None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.262101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.262294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef120-21e3-4be6-ab9c-a419d66d3bec None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.262385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.262575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef120-21e3-4be6-ab9c-a419d66d3bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.263530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:41.265119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:41.267083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 80/158] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:41.272921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.348054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.364482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffef120-21e3-4be6-ab9c-a419d66d3bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:41.370111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffef120-21e3-4be6-ab9c-a419d66d3bec None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:41.381503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800cd7b-7ca1-4803-aa61-fa4e73aa2cd4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.420178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e343aef-9f05-4e7b-8769-1a9a1b2d9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.420873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343aef-9f05-4e7b-8769-1a9a1b2d9463 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.421157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343aef-9f05-4e7b-8769-1a9a1b2d9463 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.421434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343aef-9f05-4e7b-8769-1a9a1b2d9463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.492939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e343aef-9f05-4e7b-8769-1a9a1b2d9463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:41.494461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e343aef-9f05-4e7b-8769-1a9a1b2d9463 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:41.516451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.523341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 79/159] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:03:41.529334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8295-c82a-43ae-9c44-222f8fd67b6a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.529663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8295-c82a-43ae-9c44-222f8fd67b6a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.529955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8295-c82a-43ae-9c44-222f8fd67b6a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.531560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 80/160] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:41.532726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34f7a-6d41-4899-9b79-2851329dd810 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.533023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34f7a-6d41-4899-9b79-2851329dd810 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.533304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34f7a-6d41-4899-9b79-2851329dd810 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.535721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 81/161] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:41.536656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e34f7a-6d41-4899-9b79-2851329dd810 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.559135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.605505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 81/162] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:03:41.607835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ec28-1cb6-415b-9c3e-71ceadff1b0e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.608371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ec28-1cb6-415b-9c3e-71ceadff1b0e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.613520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ec28-1cb6-415b-9c3e-71ceadff1b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.634593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a5d3ec28-1cb6-415b-9c3e-71ceadff1b0e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:41.635901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a5d3ec28-1cb6-415b-9c3e-71ceadff1b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:41.702380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e34f7a-6d41-4899-9b79-2851329dd810 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.706224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 82/163] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:41.707597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.707891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.708167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.725147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:41.726462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:41.756545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.757519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.757807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.758090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.759344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:41.760871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:41.762903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 82/164] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:41.763768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.800537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 83/165] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:41.801859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.824879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.857486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:41.910491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679a98-992e-4f47-bb06-39a031cd2f24 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.919102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfd0c0-bbfb-444e-83d8-44126aba99a0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:41.947491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.948541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.948990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.949439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.961419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:41.970629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:41.971713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:41.972545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:41.975790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 84/166] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:41.976797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:41.985338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:41.986234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:41.986518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:41.986795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:41.988161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:41.989691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:41.991527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 83/167] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:41.996718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.153437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:42.175461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5967e75-0397-405d-9169-cd5281804eba None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:42.208870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b559015-e1a3-4a28-b980-5c6b9913402a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:42.225071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:42.226128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:42.226606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:42.227092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:42.228132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=eef11ad96d374697895a79e0a7fd9e82) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:42.228662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:42.230363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:42.244583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 85/168] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/role_assignments?user.id=eef11ad96d374697895a79e0a7fd9e82&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:42.246621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.278139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:42.283766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:42.284740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:42.285635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:42.286040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:42.304629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:42.309221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:42.310353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:42.311175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:42.311921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 84/169] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:42.313590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.432519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b30f-e3ab-44e9-ab21-0059d5aa54d5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:42.472033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:42.473046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:42.473578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:42.473959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:42.474940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=6a828f4d2cba4ce2bf3d1520397c11ec) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:42.475353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:42.476168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91ac4-7934-42c6-8776-caa2536eec68 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:42.477019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:42.484900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 85/170] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:42 2022] GET /identity/v3/role_assignments?user.id=6a828f4d2cba4ce2bf3d1520397c11ec&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=c1a812e032604c4683295a602c263e78 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:42.485588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.605034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:42.605698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:42.606832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:42.607471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:42.608318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:42.609404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:42.609953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:42.611618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:42.636729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e72887-e5fc-40b3-9483-3c531e975cc5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:42.638959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 86/171] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:03:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:42.649746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.664987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:42.689223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:42.690033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:42.690358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:42.690769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:42.691541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:42.691853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:42.693482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:42.707654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 86/172] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:42.717427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.850375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668bdf6-449f-40d7-80da-cee24bc33b33 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:42.884011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:42.891019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:42.891915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:42.892234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:42.892656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:42.896639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:42.896639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:42.897829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 87/173] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:42 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:42.906829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:42.940676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bc1ed-edd6-47e0-aad9-f4e96d073410 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:43.023172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ba7f-483b-4a71-b9ab-72ceb982139d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:43.056164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:43.057592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:43.058084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:43.058717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] PATH_INFO: `/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:43.061520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] RBAC: Authorizing `identity:get_user(user_id=6a828f4d2cba4ce2bf3d1520397c11ec)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:43.061640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:43.062281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:43.062568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:43.062845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:43.064006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:43.066030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 87/174] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:42 2022] GET /identity/v3/users/6a828f4d2cba4ce2bf3d1520397c11ec => generated 275 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:43.071683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:43.140116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:43.142186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:43.180980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:43.257533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 88/175] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:03:43.263218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:43.293976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:43.377089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:43.385181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677daccd-fbed-4e50-ac72-8c3a7164642a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:43.398604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be5d2-e1c2-4dd5-aaa0-5009a32351b5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:43.430404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:43.432868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:43.432868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:43.432868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] PATH_INFO: `/v3/projects/2952afdc03a244c592a21a64ee467575` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:43.434899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] RBAC: Authorizing `identity:get_project(project_id=2952afdc03a244c592a21a64ee467575)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:43.436723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:43.438956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 89/176] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:43 2022] GET /identity/v3/projects/2952afdc03a244c592a21a64ee467575 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:43.445771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:43.509424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:43.510477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:43.510965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:43.511456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:43.605810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6780d-20cc-4152-88b5-0e235ad1744c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:43.628234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:43.629067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:43.670766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:43.671833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:43.672334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:43.672829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:43.673878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, scope.project.id=2952afdc03a244c592a21a64ee467575, user.id=6a828f4d2cba4ce2bf3d1520397c11ec) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:43.674385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:43.676056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:43.687133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 90/177] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:43 2022] GET /identity/v3/role_assignments?user.id=6a828f4d2cba4ce2bf3d1520397c11ec&scope.project.id=2952afdc03a244c592a21a64ee467575&role.id=c1a812e032604c4683295a602c263e78 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:43.729599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:43.760155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 88/178] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:43.766485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:43.806218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:43.908744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ed85-7322-406b-ba62-1bb4496b4495 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:43.954086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855844-94c0-4b3e-a5ca-78a58a057e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:43.954996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855844-94c0-4b3e-a5ca-78a58a057e78 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:43.955280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855844-94c0-4b3e-a5ca-78a58a057e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:43.955557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855844-94c0-4b3e-a5ca-78a58a057e78 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:43.956804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855844-94c0-4b3e-a5ca-78a58a057e78 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:43.958253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855844-94c0-4b3e-a5ca-78a58a057e78 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:43.960271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 91/179] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:43 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:43.969369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.112912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315e840-ef4e-42ea-85c2-51ecbf201958 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.128628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376252f-eca5-4cad-92be-195412176c46 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.128919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376252f-eca5-4cad-92be-195412176c46 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.129203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376252f-eca5-4cad-92be-195412176c46 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.130958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 92/180] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:44.136078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.136358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.136672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.156265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.156819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:44.157647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.158029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:44.158341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.158815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.159853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] RBAC: Adding query filter params (role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=6a828f4d2cba4ce2bf3d1520397c11ec) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:44.160373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:44.162063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4dff-fecc-41f4-b4dc-ce70fce0af15 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:44.169164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 89/181] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:43 2022] GET /identity/v3/role_assignments?user.id=6a828f4d2cba4ce2bf3d1520397c11ec&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:44.170910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2221ee-80dd-46a0-885a-6eb4dc99e48d None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.171398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2221ee-80dd-46a0-885a-6eb4dc99e48d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.171890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2221ee-80dd-46a0-885a-6eb4dc99e48d None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.173442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 90/182] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:44.179526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104136-8b61-4a45-a5e3-808c04a52783 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.179833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104136-8b61-4a45-a5e3-808c04a52783 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.180091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104136-8b61-4a45-a5e3-808c04a52783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.200660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c8104136-8b61-4a45-a5e3-808c04a52783 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:44.201931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c8104136-8b61-4a45-a5e3-808c04a52783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:44.263029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 93/183] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:44.273440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:44.296464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.324350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:44.330966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 91/184] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:44.332434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbadf-8fae-4918-ab29-8af452f1c72c None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.332804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbadf-8fae-4918-ab29-8af452f1c72c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.333245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbadf-8fae-4918-ab29-8af452f1c72c None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.335221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 92/185] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:44.341309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.341598 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.341905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.359791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:44.361023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:44.423399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289035b8-5fc6-4857-a5d9-bf89183c9709 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.431536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 93/186] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:44.434269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.459638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.460515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.460830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.461157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.472367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:44.480574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:44.481672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:44.482529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 94/187] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:44.483168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.556230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:44.561661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc312e7-e76e-427a-a272-948e619d9336 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.583624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:44.601486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.602299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.602589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.602869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.607217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03b23d-9dfb-470c-97ef-4c7719ec8429 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.614004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:44.621949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:44.622892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:44.623760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 94/188] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:44.628822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.644280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.645131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.645413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.645689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.655706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:44.663433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:44.664328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:44.665431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 95/189] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:44.669523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.737512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfe45e-62ff-4533-9696-74bd169d1bbd None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.769107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ac2f-b72d-440d-8b21-13e829306656 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.769951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.770708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.771052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.771390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.772145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:44.772452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:44.773908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:44.781725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 95/190] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:44.782502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.808952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.809639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.809925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.810040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:44.810199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.811116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:44.811456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:44.813527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0a5a-f79c-4915-8c4d-01bfde0983d0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:44.815691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:44.822997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 96/191] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:44.827551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa068d-2252-4912-9c6e-36ac2c8f1f39 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.827551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa068d-2252-4912-9c6e-36ac2c8f1f39 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.827551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa068d-2252-4912-9c6e-36ac2c8f1f39 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.827551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 97/192] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:44.827551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa068d-2252-4912-9c6e-36ac2c8f1f39 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.895544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418137ec-6275-49ed-ac17-e4b9c45e77cf None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.928118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.928822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.929105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.929385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.930141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:44.930450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:44.931852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:44.933135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa068d-2252-4912-9c6e-36ac2c8f1f39 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:44.939793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 96/193] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:44.940575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:44.973991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9008899-9fd9-4f2c-b933-5844a7aa5560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:44.974878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008899-9fd9-4f2c-b933-5844a7aa5560 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.975157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008899-9fd9-4f2c-b933-5844a7aa5560 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.975433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008899-9fd9-4f2c-b933-5844a7aa5560 None admin] PATH_INFO: `/v3/users/ffd5df0275b14a2b927be72888fa3235` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:44.989011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9008899-9fd9-4f2c-b933-5844a7aa5560 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5df0275b14a2b927be72888fa3235)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:44.990425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9008899-9fd9-4f2c-b933-5844a7aa5560 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:44.992074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 98/194] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/users/ffd5df0275b14a2b927be72888fa3235 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:44.996850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:44.996850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:44.996850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.009064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:45.010294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:45.019993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.037890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbe429-5fa6-4a07-846e-2ed55e5681d5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.058876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.071773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512956-8946-4932-8153-434e7281b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.072696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512956-8946-4932-8153-434e7281b227 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.072984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512956-8946-4932-8153-434e7281b227 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.073264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512956-8946-4932-8153-434e7281b227 None admin] PATH_INFO: `/v3/users/ffd5df0275b14a2b927be72888fa3235` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.074471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512956-8946-4932-8153-434e7281b227 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5df0275b14a2b927be72888fa3235)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.075673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 99/195] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:45.076058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512956-8946-4932-8153-434e7281b227 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.080702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 97/196] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:44 2022] GET /identity/v3/users/ffd5df0275b14a2b927be72888fa3235 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:45.080702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512956-8946-4932-8153-434e7281b227 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.082591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.179913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9cb3e-58c3-42c4-a2c2-2be80ed3aeee None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.181526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512956-8946-4932-8153-434e7281b227 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.212559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.213472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.213754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.214030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] PATH_INFO: `/v3/users/9aed0761ce524285be213bcc811e2bab` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.214373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.215024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.215208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] RBAC: Authorizing `identity:get_user(user_id=9aed0761ce524285be213bcc811e2bab)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.215298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.215564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.216721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.218366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 100/197] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/users/9aed0761ce524285be213bcc811e2bab => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:45.219132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.241946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.275163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.290561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.292066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.317732 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e41dce-2cb3-4d6e-b47d-3d8ee4a151b1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.350599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.351254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.351542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.351828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.389913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 98/198] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:45.391080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.423000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.424471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.440496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.476077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.489307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3ddd6-77a9-458d-b037-8054331f3376 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.521517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 101/199] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:45.525280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.526439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.526727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.526857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.527003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.528201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.529770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.531383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 99/200] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:45.536882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.621863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7472a-49c9-4eca-88bd-1a5127948bb1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.634745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71517b6-9c95-47dc-9c87-67cbfe337e48 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.652101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.655578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.656225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.656510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.656832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.669536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.670447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.670732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.671007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.672181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.673682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.675376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 100/201] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:45.676146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.683383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.725777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.727277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.776062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d36b20-e63c-478c-b3ab-bb513c3aa725 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.810759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.811624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.811903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.812169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.813680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.815150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.816871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 101/202] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:45.817603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.836862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 102/203] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:45.836862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.870328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.887195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:45.913141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3522-cc6c-4c95-b04e-55b3eee90898 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.932051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8211cfe-2a18-4f96-8d73-142bb4bcf0fa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:45.946864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.947535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.947818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.948093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.948840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.950320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.966309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:45.967043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:45.967330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:45.967610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:45.968449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] RBAC: Adding query filter params (role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=ffd5df0275b14a2b927be72888fa3235) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:45.968789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:45.970280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:45.970860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 102/204] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:45 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:45.982255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:45.982335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 103/205] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/role_assignments?user.id=ffd5df0275b14a2b927be72888fa3235&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:45.982335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:46.116248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6041-d07f-4fa5-8386-0bf98fc99028 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:46.127887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd891791-b446-47cb-96c2-6a2c469c4f76 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:46.131068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:46.156872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:46.162808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:46.163641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:46.163991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:46.164336 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:46.165328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=ffd5df0275b14a2b927be72888fa3235) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:46.165709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:46.167753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:46.174421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 103/206] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/role_assignments?user.id=ffd5df0275b14a2b927be72888fa3235&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:46.182849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae470013-4605-478e-aaf3-332153a98fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:46.184109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470013-4605-478e-aaf3-332153a98fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:46.184388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470013-4605-478e-aaf3-332153a98fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:46.184699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470013-4605-478e-aaf3-332153a98fb0 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:46.186101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae470013-4605-478e-aaf3-332153a98fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:46.187708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae470013-4605-478e-aaf3-332153a98fb0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:46.189596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 104/207] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:45 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:46.195743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:46.320243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc530-2a6b-41e9-84a0-fad07ce686ee None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:46.360536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:46.361265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:46.361547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:46.361824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:46.362681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] RBAC: Adding query filter params (role.id=32158fa17dd24a27aa60e7f3a9fb806d, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd, user.id=9aed0761ce524285be213bcc811e2bab) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:46.363003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:46.364495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccbdbe-6dfd-4b53-8d9f-2efae91736bf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:46.372100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 104/208] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:46 2022] GET /identity/v3/role_assignments?user.id=9aed0761ce524285be213bcc811e2bab&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=32158fa17dd24a27aa60e7f3a9fb806d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:48.211076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296e08-ab48-43f2-8e9f-c52cc1579d93 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.211618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296e08-ab48-43f2-8e9f-c52cc1579d93 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.211618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296e08-ab48-43f2-8e9f-c52cc1579d93 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.214173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 105/209] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:48.220551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361fe8-c244-4157-b800-bcaeb1ea7981 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.221107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361fe8-c244-4157-b800-bcaeb1ea7981 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.221180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361fe8-c244-4157-b800-bcaeb1ea7981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.240894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c3361fe8-c244-4157-b800-bcaeb1ea7981 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:48.242185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c3361fe8-c244-4157-b800-bcaeb1ea7981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:48.281672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:48.319762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:48.341760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f296e08-ab48-43f2-8e9f-c52cc1579d93 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:48.426411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509acfbd-24b9-4db6-8035-210f5d4466b2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.427049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509acfbd-24b9-4db6-8035-210f5d4466b2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.427331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509acfbd-24b9-4db6-8035-210f5d4466b2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.428875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 106/211] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:48.431327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462d48f-a81f-404a-90ac-f0f9888e2115 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.431613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462d48f-a81f-404a-90ac-f0f9888e2115 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.431888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462d48f-a81f-404a-90ac-f0f9888e2115 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.435925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 107/212] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:48.437684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38373953-129f-435d-b804-f4c86f9be218 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.437978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38373953-129f-435d-b804-f4c86f9be218 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.438246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38373953-129f-435d-b804-f4c86f9be218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.444580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f296e08-ab48-43f2-8e9f-c52cc1579d93 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:48.457020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-38373953-129f-435d-b804-f4c86f9be218 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:48.458237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-38373953-129f-435d-b804-f4c86f9be218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:48.486111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ee696-bb82-4178-99af-88e79dd0c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:48.487458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee696-bb82-4178-99af-88e79dd0c602 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.487750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee696-bb82-4178-99af-88e79dd0c602 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.488168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee696-bb82-4178-99af-88e79dd0c602 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.498860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ee696-bb82-4178-99af-88e79dd0c602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d91ee696-bb82-4178-99af-88e79dd0c602 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:48.507088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:48.507961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 106/213] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:03:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:48.513886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.514602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.514602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.526981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:48.528177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:48.537902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 108/214] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:48.538736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38373953-129f-435d-b804-f4c86f9be218 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:48.580423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:48.614864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 107/215] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:48.620805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:48.656919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:48.661343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38373953-129f-435d-b804-f4c86f9be218 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:48.697171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:48.697852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.698202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.698410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.699175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:48.699512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:48.700962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:48.709010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 109/216] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:03:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:48.709880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:48.722023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3603309-6681-4e60-a46e-0784b41d82f4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:48.756741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e8ea-218a-4757-b0da-d6a691a3bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:48.757556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e8ea-218a-4757-b0da-d6a691a3bd4f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.757927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e8ea-218a-4757-b0da-d6a691a3bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.758261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e8ea-218a-4757-b0da-d6a691a3bd4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.768862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212e8ea-218a-4757-b0da-d6a691a3bd4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b212e8ea-218a-4757-b0da-d6a691a3bd4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:48.776517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:48.777631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:48.778643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 108/217] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:48.783857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5bb8-d793-4ac5-bf6c-1dd4cf8f0df7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.784153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5bb8-d793-4ac5-bf6c-1dd4cf8f0df7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.784423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5bb8-d793-4ac5-bf6c-1dd4cf8f0df7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.786016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 109/218] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:48.786460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd5bb8-d793-4ac5-bf6c-1dd4cf8f0df7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:48.823408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:48.825383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8107f-b992-4106-a211-5cd7d375aa8e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:48.859463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:48.860265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.860546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.860853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.870984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:48.879704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:48.880842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:48.881695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 110/219] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:48.882350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:48.895098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd5bb8-d793-4ac5-bf6c-1dd4cf8f0df7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:48.905724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:48.928424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77191a1-07e7-468c-be3b-6879f6f38774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:48.929344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77191a1-07e7-468c-be3b-6879f6f38774 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.929629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77191a1-07e7-468c-be3b-6879f6f38774 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.929905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77191a1-07e7-468c-be3b-6879f6f38774 None admin] PATH_INFO: `/v3/users/ffd5df0275b14a2b927be72888fa3235` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.931103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77191a1-07e7-468c-be3b-6879f6f38774 None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5df0275b14a2b927be72888fa3235)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:48.932592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77191a1-07e7-468c-be3b-6879f6f38774 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:48.934236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 110/220] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:48 2022] GET /identity/v3/users/ffd5df0275b14a2b927be72888fa3235 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:48.937973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:48.938372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:48.938674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:48.956557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:48.958071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:48.988771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a42c9-af58-4ee6-8add-aaead0a93360 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.022432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.023034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.023378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.023660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.024439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:49.024788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.026215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.028429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 111/221] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:49.029018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.039141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 111/222] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.040095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.066956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.132659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.135102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0ea5e-0d4f-4cbb-94fa-79cac7908c33 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.153691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9213825-7fb3-475c-b3ed-96856f92a14d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.171983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.172658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.172968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.173241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.173998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:49.174302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.175820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.184462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 112/223] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.185282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.191944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.192850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.193135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.193412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.194602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.196077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.197951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 112/224] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.198640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.288303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.295683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326c53-ba78-4ff7-b8df-13eb86632301 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.301533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad55a8-a2e2-4ad4-890d-cb5af7af2e41 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.331531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.332425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.332752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.333044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] PATH_INFO: `/v3/users/0fb9052fb18c49c7a116381d4c86bf05` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.334565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.335370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.335652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.335959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.337196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.338658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.340288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 113/225] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.345203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.347462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] RBAC: Authorizing `identity:get_user(user_id=0fb9052fb18c49c7a116381d4c86bf05)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.348976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.350692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 113/226] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/users/0fb9052fb18c49c7a116381d4c86bf05 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.351428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.365938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.446534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab6fa-2e8d-4b17-b705-18d4f6e455e1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.452037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e9a6-1fcd-4a67-a21c-0060cd0cc19c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.481705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.482619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.482895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.483174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] PATH_INFO: `/v3/users/ffd5df0275b14a2b927be72888fa3235` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.484354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5df0275b14a2b927be72888fa3235)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.486533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.486639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.486752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.487035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.487310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/ffd5df0275b14a2b927be72888fa3235/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.487783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 114/227] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/users/ffd5df0275b14a2b927be72888fa3235 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.488546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.493722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=969a2852273f47a3be56fa55ecc75dcf, user_id=ffd5df0275b14a2b927be72888fa3235, role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.495193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.509500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 114/228] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:49 2022] PUT /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/ffd5df0275b14a2b927be72888fa3235/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:49.510516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.528999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.607736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.626111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd76c-29a7-48b2-8b8f-7ede5a1b60bc None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.629469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723427b-94d8-4409-8f9a-58b78893f2e6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.664086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.664309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.664952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.665081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.665363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.665451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.665746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.665830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.666603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.668175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.693340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 115/229] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:49 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:49.694249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.766625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.768337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.785916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:49.847218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ae206-11ad-41af-ba6b-6e4f9175d377 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:49.888333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 115/230] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:49.889544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.891503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:49.892768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:49.893056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:49.894326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:49.895562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:49.897120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:49.899664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 116/231] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:49.905426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:49.921791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:50.019299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f47a-6a5f-4d90-85c5-82514fefd501 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:50.038698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b75d02-205a-4406-abb2-f167b1f33925 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:50.039511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:50.068572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:50.070662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:50.071019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:50.071434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:50.074256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:50.075133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:50.077533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 116/232] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:49 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:50.083214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9437a8-aab4-44f3-9214-80b74d078b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:50.083443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:50.084132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9437a8-aab4-44f3-9214-80b74d078b60 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:50.084416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9437a8-aab4-44f3-9214-80b74d078b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:50.084733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9437a8-aab4-44f3-9214-80b74d078b60 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/ffd5df0275b14a2b927be72888fa3235/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:50.086748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9437a8-aab4-44f3-9214-80b74d078b60 None admin] RBAC: Authorizing `identity:create_grant(project_id=969a2852273f47a3be56fa55ecc75dcf, user_id=ffd5df0275b14a2b927be72888fa3235, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:50.088247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9437a8-aab4-44f3-9214-80b74d078b60 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:50.104480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 117/233] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:49 2022] PUT /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/ffd5df0275b14a2b927be72888fa3235/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:50.207669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826804-f727-40f6-85c7-3a381a52b3fa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:50.245004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:50.245738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:50.246025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:50.246353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:50.247209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=0fb9052fb18c49c7a116381d4c86bf05) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:50.247524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:50.249111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dd19-06ea-4fe7-8a22-7fccc34b5b47 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:50.256693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 117/234] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:50 2022] GET /identity/v3/role_assignments?user.id=0fb9052fb18c49c7a116381d4c86bf05&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=c1a812e032604c4683295a602c263e78 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:51.887646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740fd3f-b94b-460b-bfe3-9b455b3cc29f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:51.888701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740fd3f-b94b-460b-bfe3-9b455b3cc29f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:51.889209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740fd3f-b94b-460b-bfe3-9b455b3cc29f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:51.891357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 118/235] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:51.897137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:51.897942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:51.898522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:51.915911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:51.917496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:51.961114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:51.992695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 118/236] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:52.009991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740fd3f-b94b-460b-bfe3-9b455b3cc29f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:52.087102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:52.126679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740fd3f-b94b-460b-bfe3-9b455b3cc29f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:52.161085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:52.162270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.162747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.163211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.173927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:52.182489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:52.183373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:03:52.184159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:52.191347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 119/237] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:03:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:52.193069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:52.293959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633a7a7-700b-4151-81dc-b7a451d4159e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:52.346789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:52.347835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.348315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.348819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.349798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:52.350299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:52.351908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:52.364675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 119/238] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:03:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:52.370501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:52.512212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ded2c-648a-4287-a8a8-18edb0c3a0ce None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:52.562413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:52.574108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644a0d-1bc2-424a-b201-fb03d48f415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:52.575018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644a0d-1bc2-424a-b201-fb03d48f415a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.575327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644a0d-1bc2-424a-b201-fb03d48f415a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.575604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644a0d-1bc2-424a-b201-fb03d48f415a None admin] PATH_INFO: `/v3/users/ffd5df0275b14a2b927be72888fa3235` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.577028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94644a0d-1bc2-424a-b201-fb03d48f415a None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5df0275b14a2b927be72888fa3235)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:52.578537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94644a0d-1bc2-424a-b201-fb03d48f415a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:52.580487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 120/239] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:52 2022] GET /identity/v3/users/ffd5df0275b14a2b927be72888fa3235 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:52.586545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:52.657114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:52.721264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceec9d-36b4-4390-bb89-08213d5b334c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:52.762057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:52.762733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.763026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.763310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.772230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7053c-5f2a-4956-83b0-daadd1c3b81a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.772523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7053c-5f2a-4956-83b0-daadd1c3b81a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.772846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7053c-5f2a-4956-83b0-daadd1c3b81a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.774468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 121/240] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:52.781965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b9ee3-7e5d-4abb-9b3a-9bf10364115b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.782248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b9ee3-7e5d-4abb-9b3a-9bf10364115b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.782565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b9ee3-7e5d-4abb-9b3a-9bf10364115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.808591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f38b9ee3-7e5d-4abb-9b3a-9bf10364115b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:52.809778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f38b9ee3-7e5d-4abb-9b3a-9bf10364115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:52.842316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:52.843816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:52.886619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 122/241] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:52.887026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:52.889626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04094-a73b-4a05-b99b-f1bca1cd2b6a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.890073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04094-a73b-4a05-b99b-f1bca1cd2b6a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.890278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04094-a73b-4a05-b99b-f1bca1cd2b6a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.892145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 123/242] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:52.902714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:52.903005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:52.903292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:52.930456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:52.931814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:52.948652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 120/243] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:52.949515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.027588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 124/244] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:53.028561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.057437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64762-c84b-47ee-ab3f-6bba3999c62d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.093825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.094640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.094925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.095201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.096370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:53.097941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:53.099704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 121/245] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:53.104379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.105105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.112344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.147857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1065cb3-427e-4b19-a83f-4886fd0b0a80 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.181919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8394e1-9aba-4161-9d4b-8d2ae347ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.182686 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8394e1-9aba-4161-9d4b-8d2ae347ce04 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.182966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8394e1-9aba-4161-9d4b-8d2ae347ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.183242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8394e1-9aba-4161-9d4b-8d2ae347ce04 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.184409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8394e1-9aba-4161-9d4b-8d2ae347ce04 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:53.186029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8394e1-9aba-4161-9d4b-8d2ae347ce04 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:53.187720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 125/246] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:53.188896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd625c4-97b0-42f3-b290-a3eda35d8ff0 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.189183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd625c4-97b0-42f3-b290-a3eda35d8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.189455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd625c4-97b0-42f3-b290-a3eda35d8ff0 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.190912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 126/247] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:53.191598 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd625c4-97b0-42f3-b290-a3eda35d8ff0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.207103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086854f5-d397-477e-966f-24f0efaee7f5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.240626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601473e8-c827-44fe-a70e-4f1cd0470163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.241492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601473e8-c827-44fe-a70e-4f1cd0470163 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.241778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601473e8-c827-44fe-a70e-4f1cd0470163 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.242055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601473e8-c827-44fe-a70e-4f1cd0470163 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.252587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601473e8-c827-44fe-a70e-4f1cd0470163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-601473e8-c827-44fe-a70e-4f1cd0470163 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:53.260421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:53.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:53.262206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 122/248] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:53.263366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e439bdc-8508-4a04-a346-317b0630b1f2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.263366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e439bdc-8508-4a04-a346-317b0630b1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.263526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e439bdc-8508-4a04-a346-317b0630b1f2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.264942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 123/249] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:53.265970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e439bdc-8508-4a04-a346-317b0630b1f2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.292438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd625c4-97b0-42f3-b290-a3eda35d8ff0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.318724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.328022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99297c6-a753-4a2f-aabf-9bcc3ec30f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.328750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99297c6-a753-4a2f-aabf-9bcc3ec30f8d None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.329038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99297c6-a753-4a2f-aabf-9bcc3ec30f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.329312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99297c6-a753-4a2f-aabf-9bcc3ec30f8d None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.330018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99297c6-a753-4a2f-aabf-9bcc3ec30f8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:53.331482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99297c6-a753-4a2f-aabf-9bcc3ec30f8d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:53.332279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.351328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 127/250] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:53 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:53.352564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021c334-d70a-4638-93da-1da017c8310f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.352899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021c334-d70a-4638-93da-1da017c8310f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.353177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021c334-d70a-4638-93da-1da017c8310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.368782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e439bdc-8508-4a04-a346-317b0630b1f2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.378002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e021c334-d70a-4638-93da-1da017c8310f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:53.379251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e021c334-d70a-4638-93da-1da017c8310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:53.408766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.409457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.409748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.410238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.410922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] RBAC: Adding query filter params (role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=ffd5df0275b14a2b927be72888fa3235) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:53.411206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:53.412757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:53.419779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 124/251] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/role_assignments?user.id=ffd5df0275b14a2b927be72888fa3235&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:53.421143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.477756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 128/252] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:53.479132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.479487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.480100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.502308 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:53.504372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:53.544577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aff1d-5d8a-4cfc-8687-da46202c65f7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.580577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.589643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.590383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.590713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.591078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.591792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:53.592105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:53.594167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:53.604250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 125/253] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:53.604466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 129/254] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:53.605046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.611291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.668991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.738287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906239e9-4639-4d7e-af06-044fc9f0f802 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.747176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274c3a0-3638-42db-a5d1-e3b3933759c1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.789559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.790683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.791140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.791573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.794997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.795890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.796171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.796735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] PATH_INFO: `/v3/users/405190de0ea44748b885c14ed28b6ad5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.808842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:53.811554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] RBAC: Authorizing `identity:get_user(user_id=405190de0ea44748b885c14ed28b6ad5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:53.813574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:53.814980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 130/255] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/users/405190de0ea44748b885c14ed28b6ad5 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:53.817338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:53.818197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:53.818978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 126/256] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:53.820288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.820833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:53.884382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.933005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:53.934648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b3ef4-3602-4cd6-b512-5b46e43bb496 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.937976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1384-2174-4619-bfd6-a1310220eec7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:53.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.971303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.971820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.972328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.973656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:53.974567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:53.974934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:53.975299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:53.987195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:53.995872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:53.996866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:53.997635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 131/257] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:54.003490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.049724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.051569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.113158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:54.117935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af04bd-f208-4630-896c-aed59ac06e50 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.157160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.157843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.158124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.158397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.159150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:54.159454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.160902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.169962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 132/258] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.170580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.175699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 127/259] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:54.176561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.201278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:54.288985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09f9a-60ee-4e90-a840-56deff017461 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.299357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162c571-23ba-4f62-bfb2-f6827e1d7ff9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.325730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.326479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.326860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.327146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.327957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:54.328276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.329712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.334075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.334962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.335243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.335521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] PATH_INFO: `/v3/users/0fb9052fb18c49c7a116381d4c86bf05` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.336792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] RBAC: Authorizing `identity:get_user(user_id=0fb9052fb18c49c7a116381d4c86bf05)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.338261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.340155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 128/261] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/users/0fb9052fb18c49c7a116381d4c86bf05 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.340993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.344083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 133/261] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.345000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.368108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:54.438512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:54.449698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129fbf7-e1c9-4c0c-9813-7efe687bb24b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.456070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a81cf-28b6-45d5-b0ac-e002e143ef68 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.484584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.485654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.485946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.486219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.487402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.488901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.490595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 129/262] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.491351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.492163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.493078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.493365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.493641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] PATH_INFO: `/v3/users/ffd5df0275b14a2b927be72888fa3235` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.495087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] RBAC: Authorizing `identity:get_user(user_id=ffd5df0275b14a2b927be72888fa3235)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.496705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.498404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 134/263] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/users/ffd5df0275b14a2b927be72888fa3235 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.499167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.593374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:54.606547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddda9cd-2143-4d2b-af66-1a68597e6fe0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.607556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca176a-48af-4f5a-af6f-ff06c5487d7d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.640886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.641765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.642046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.642321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.643101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.643485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.643768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.644065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.644349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.644999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.645227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] RBAC: Adding query filter params (role.id=32158fa17dd24a27aa60e7f3a9fb806d, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=405190de0ea44748b885c14ed28b6ad5) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:54.645544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.646992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 130/264] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.647175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.647765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.653347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 135/265] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/role_assignments?user.id=405190de0ea44748b885c14ed28b6ad5&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=32158fa17dd24a27aa60e7f3a9fb806d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:54.654187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:54.673994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:54.804739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e998-b283-40bc-a359-493e5e24d736 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.860502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752b5c-71f2-40aa-8334-2ffca2209efb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:54.882083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.883003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.883281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.883553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/0fb9052fb18c49c7a116381d4c86bf05/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.886576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] RBAC: Authorizing `identity:create_grant(project_id=969a2852273f47a3be56fa55ecc75dcf, user_id=0fb9052fb18c49c7a116381d4c86bf05, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:54.888087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:54.913964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 136/266] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:54 2022] PUT /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/0fb9052fb18c49c7a116381d4c86bf05/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:54.936382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:54.937207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:54.937497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:54.937785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:54.973462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:55.035734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:55.038209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:55.146144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 131/267] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:03:55.151780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:55.258663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:55.290692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c8f2d-f4ae-4c2d-8284-1b8f916f1741 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:55.342033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f251a0b-b93d-4c2f-b31d-56bd24592cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:55.343337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f251a0b-b93d-4c2f-b31d-56bd24592cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:55.343812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f251a0b-b93d-4c2f-b31d-56bd24592cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:55.344308 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f251a0b-b93d-4c2f-b31d-56bd24592cd3 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:55.345818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f251a0b-b93d-4c2f-b31d-56bd24592cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:55.347602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f251a0b-b93d-4c2f-b31d-56bd24592cd3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:55.349507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 137/268] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:55 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:55.355411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:55.433830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:55.476706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a73446-81eb-4ee5-9c73-93c210bb163a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:55.511870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:55.512589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:55.512924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:55.513239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:55.514120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=ffd5df0275b14a2b927be72888fa3235) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:55.514442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:55.516240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8677cfd-fd5d-45b6-b371-3c134d957226 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:55.523021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 132/269] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:55 2022] GET /identity/v3/role_assignments?user.id=ffd5df0275b14a2b927be72888fa3235&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:55.963130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696cbd-237e-4d69-a2bd-6dffee6913c2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:55.963532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696cbd-237e-4d69-a2bd-6dffee6913c2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:55.963705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696cbd-237e-4d69-a2bd-6dffee6913c2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:55.965569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 138/270] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:55.972170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:55.972471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:55.972796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:55.990373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:55.991580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:56.029370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483603-4075-406e-90e7-3dabb3ad2862 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.029997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483603-4075-406e-90e7-3dabb3ad2862 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.030494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483603-4075-406e-90e7-3dabb3ad2862 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.032270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 139/271] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:56.038697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.039211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.039696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.058713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:56.060160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:56.061715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 133/272] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:56.087059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.131637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 140/273] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:56.139828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:56.161785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.199494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37e3e1-dd61-4ee0-a4d0-78a329ce904d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.235030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.235583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.235876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.236157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.237379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:56.238845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:56.244781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:56.247175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 134/274] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:56.248499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.277213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ee0d-92b4-4a5e-8158-c5d8c8301648 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.318067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.319258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.319748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.320333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.331915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:56.341555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:56.342434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:56.343219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:56.346201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 141/275] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:03:56.352104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.356881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccd908-b6d9-46d5-9142-b54bdefdc2fc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.374506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:56.393893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.395235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.395235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.395525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.396986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:56.398520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:56.422301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 135/276] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:03:56 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:03:56.474884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198bfc8-3bf8-4438-9c4c-91d616dfff47 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.513178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.514363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.514879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.515648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.516661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:56.517180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:56.518822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:56.520693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:56.530706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 142/277] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:56.537240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.648248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78ae2-dff6-45e6-bd0a-0e44ae29ac55 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.683534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce970c11-3747-4e6b-9fa2-9e2224f49070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.684814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce970c11-3747-4e6b-9fa2-9e2224f49070 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.685350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce970c11-3747-4e6b-9fa2-9e2224f49070 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.685847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce970c11-3747-4e6b-9fa2-9e2224f49070 None admin] PATH_INFO: `/v3/users/6c170f42d0b64464b5907af37238f8d0` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.700664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce970c11-3747-4e6b-9fa2-9e2224f49070 None admin] RBAC: Authorizing `identity:get_user(user_id=6c170f42d0b64464b5907af37238f8d0)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:56.702515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce970c11-3747-4e6b-9fa2-9e2224f49070 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:56.704812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 136/278] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:56 2022] GET /identity/v3/users/6c170f42d0b64464b5907af37238f8d0 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:56.710639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.824980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f279f-c7e1-4ffa-8354-e61bad5bee65 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.864648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.865327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.865616 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.865896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.866775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, user.id=6c170f42d0b64464b5907af37238f8d0, scope.system=all) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:56.867093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:56.868571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b46ef-e078-4acc-b07b-538ff72346cb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:56.874658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 143/279] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 17:03:56 2022] GET /identity/v3/role_assignments?user.id=6c170f42d0b64464b5907af37238f8d0&scope.system=all&role.id=c1a812e032604c4683295a602c263e78 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:57.303027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae6a0-0e27-49d5-a124-167b5f965e17 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:57.303551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae6a0-0e27-49d5-a124-167b5f965e17 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:57.303551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae6a0-0e27-49d5-a124-167b5f965e17 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:57.305252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 137/280] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:57.310406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4d06-6b96-4157-8a15-98bbdb46e46c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:57.310827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4d06-6b96-4157-8a15-98bbdb46e46c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:57.310993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4d06-6b96-4157-8a15-98bbdb46e46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:57.333596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d9bc4d06-6b96-4157-8a15-98bbdb46e46c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:57.334807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d9bc4d06-6b96-4157-8a15-98bbdb46e46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:57.408827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.426496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 144/281] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:57.460572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ae6a0-0e27-49d5-a124-167b5f965e17 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:57.472913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a1a7f-a3fa-441d-ba03-a6312c44f7ea None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:57.473214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a1a7f-a3fa-441d-ba03-a6312c44f7ea None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:57.473474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a1a7f-a3fa-441d-ba03-a6312c44f7ea None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:57.474868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 145/282] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:57.480168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:57.480454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:57.480769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:57.511321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:57.512503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:57.516037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.630550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 146/283] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:57.633969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ae6a0-0e27-49d5-a124-167b5f965e17 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:57.656532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:57.699235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:57.700425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:57.703178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:57.703654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:57.723248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:57.738375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:57.739271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:57.740034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:57.742675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 138/284] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:57.748493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:57.833874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4396-7995-49c5-bdd1-8906a63a2fb6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:57.877935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.908941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:57.909809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:57.910089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:57.912467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:57.934066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:57.942335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:57.944223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:57.946339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:03:57.947125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 147/285] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:03:57.951472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:57.969041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174023-c1e6-49a2-a707-e869bb7d7c5d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.034199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.034890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.035179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.035457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.036213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:58.036527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.037950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.058733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 139/286] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:58.062643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:58.145965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3fad-3ca5-4941-a1ad-7d18b312fcea None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.211018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e509d-e961-405c-97b9-288c708cd036 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.241865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.242556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.242844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.243120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.243884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:58.244196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.245629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.249065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.250201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.250551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.250896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] PATH_INFO: `/v3/users/405190de0ea44748b885c14ed28b6ad5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.252184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] RBAC: Authorizing `identity:get_user(user_id=405190de0ea44748b885c14ed28b6ad5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.253733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.255794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 140/287] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:58 2022] GET /identity/v3/users/405190de0ea44748b885c14ed28b6ad5 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:58.262638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 148/288] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:58.268178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:58.268434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:58.307386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:58.321977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:58.372267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d4f9b-6e8a-4e1a-9e4e-ae0c8a2aef66 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.407342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.408553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.409102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.409660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.411077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.412824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.415032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 149/289] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:58 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:58.420932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:58.518148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb382-7117-4132-a230-ec7eb399d85b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.530233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562ef4a-ac4a-436d-a09e-5de50bc671a4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.552959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:58.562176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.563079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.563367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.563647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] PATH_INFO: `/v3/users/0fb9052fb18c49c7a116381d4c86bf05` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.565630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] RBAC: Authorizing `identity:get_user(user_id=0fb9052fb18c49c7a116381d4c86bf05)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.567118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.568987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 141/290] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:58 2022] GET /identity/v3/users/0fb9052fb18c49c7a116381d4c86bf05 => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:58.574167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:58.600748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.601653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.601932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.602208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/405190de0ea44748b885c14ed28b6ad5/roles/32158fa17dd24a27aa60e7f3a9fb806d` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.606077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] RBAC: Authorizing `identity:create_grant(project_id=969a2852273f47a3be56fa55ecc75dcf, user_id=405190de0ea44748b885c14ed28b6ad5, role_id=32158fa17dd24a27aa60e7f3a9fb806d)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.607625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.632989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 150/291] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:03:58 2022] PUT /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf/users/405190de0ea44748b885c14ed28b6ad5/roles/32158fa17dd24a27aa60e7f3a9fb806d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:58.700659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:58.718913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cadb-26fa-457e-9872-16feae4e8172 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:58.768490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae974ae-80ee-4d55-8ce5-3c4df8ec5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:58.769251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae974ae-80ee-4d55-8ce5-3c4df8ec5b00 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:58.769536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae974ae-80ee-4d55-8ce5-3c4df8ec5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:58.769809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae974ae-80ee-4d55-8ce5-3c4df8ec5b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:58.882157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae974ae-80ee-4d55-8ce5-3c4df8ec5b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:58.883733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae974ae-80ee-4d55-8ce5-3c4df8ec5b00 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:58.980918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:58.991528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 142/292] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:03:58.997189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.100373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455b90-3679-4533-a35d-5cdc53adb4c6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.100688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455b90-3679-4533-a35d-5cdc53adb4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.100878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455b90-3679-4533-a35d-5cdc53adb4c6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.102261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 143/293] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:59.109207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17013-d114-49b8-90e4-321496225836 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.109497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17013-d114-49b8-90e4-321496225836 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.109768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17013-d114-49b8-90e4-321496225836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.129192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-41b17013-d114-49b8-90e4-321496225836 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:59.130669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41b17013-d114-49b8-90e4-321496225836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:59.150718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307fbc-09c8-43b1-8adc-b02964b6a30c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.188384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.189281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.189561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.189832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.191801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:59.193302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:59.195177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 151/294] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:03:58 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:59.204229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.283966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 144/295] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:59.289516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:59.323180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17013-d114-49b8-90e4-321496225836 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.378701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701e5c-914e-4902-9977-e3ccea78341f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.432626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17013-d114-49b8-90e4-321496225836 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.432849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.432849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.432849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.432849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.433391 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=0fb9052fb18c49c7a116381d4c86bf05) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:59.435186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68882d2-ee08-4928-a343-1ff3f0c7f090 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:59.441715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 152/296] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/role_assignments?user.id=0fb9052fb18c49c7a116381d4c86bf05&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=c1a812e032604c4683295a602c263e78 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:59.443022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330993-1479-44de-9c20-e1ab3aad9d43 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.443310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330993-1479-44de-9c20-e1ab3aad9d43 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.443682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330993-1479-44de-9c20-e1ab3aad9d43 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.445187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 153/297] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:03:59.451024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e0289-6f4f-40ce-a040-b0bb1dca8c62 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.451543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e0289-6f4f-40ce-a040-b0bb1dca8c62 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.451960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e0289-6f4f-40ce-a040-b0bb1dca8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.482450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:59.492314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-158e0289-6f4f-40ce-a040-b0bb1dca8c62 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:59.493581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-158e0289-6f4f-40ce-a040-b0bb1dca8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:59.501541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.502370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.502659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.502933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.526819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:03:59.536296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:03:59.537259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:03:59.538029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:03:59.545891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 145/298] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:03:59.551923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.646004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 154/299] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:03:59.663033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e884-9db0-4747-b148-99e73097a990 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.663547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e884-9db0-4747-b148-99e73097a990 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.664000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e884-9db0-4747-b148-99e73097a990 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.668630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 155/300] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:03:59.671067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.671556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.672013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.690104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:03:59.691556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:59.716186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8b557-0401-4ef3-830e-b1f51833d177 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.728516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:59.759172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.760119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.760410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.760778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.761606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:03:59.761932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:59.764381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:59.775031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 146/301] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:59.776630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.783007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 156/302] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:03:59.783007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.839366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:59.891588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320eb84-eb54-4c71-af4e-1c24aee89c72 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.897174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf4016-9007-4bb2-bd3b-2719ace2a5f2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.926092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.926969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.927251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.927522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] PATH_INFO: `/v3/users/9b29d13640f04cbe9122ad4cba079080` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.934149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.934947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.935341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.936027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.937492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:59.939427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:59.946203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] RBAC: Authorizing `identity:get_user(user_id=9b29d13640f04cbe9122ad4cba079080)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:59.946332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 147/303] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:03:59.946332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.946486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:59.946486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 157/304] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/users/9b29d13640f04cbe9122ad4cba079080 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:03:59.946868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.969294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:00.047248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb8e8-ff35-4e8f-a862-75fa7d812a68 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:00.061412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c8570-15a1-4312-806d-f685d37272f8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:00.073132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:00.085609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:00.086504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:00.086779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:00.087207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] PATH_INFO: `/v3/groups` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:00.088030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:00.089655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:00.098475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:00.104683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:00.104683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:00.104683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:00.105460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 158/305] 10.222.0.46 () {60 vars in 1134 bytes} [Mon May 23 17:03:59 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:00.106578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:00.123495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:00.132265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:00.133345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:00.134138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:00.136694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 148/306] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:00.143414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:00.208139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:00.232006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072636d-430c-497b-8f76-4bf2f86b6000 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:00.270659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:00.271442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:00.271788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:00.272181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:00.273814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] RBAC: Adding query filter params (role.id=32158fa17dd24a27aa60e7f3a9fb806d, user.id=9b29d13640f04cbe9122ad4cba079080, scope.system=all) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:00.274215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:00.276147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:00.284442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 159/307] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 17:04:00 2022] GET /identity/v3/role_assignments?user.id=9b29d13640f04cbe9122ad4cba079080&scope.system=all&role.id=32158fa17dd24a27aa60e7f3a9fb806d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:00.289027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675bab6-9915-4e69-99fe-12cc7057a65b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:00.332887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:00.334360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:00.334821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:00.335273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:00.336208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:00.336734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:00.338341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:00.348527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 149/308] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:00.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:00.470209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb6e9-635f-4396-b269-59b3b647ca31 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:00.507966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2c94b-b5d7-48a1-9261-7acab64e0712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:00.508890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c94b-b5d7-48a1-9261-7acab64e0712 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:00.509173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c94b-b5d7-48a1-9261-7acab64e0712 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:00.509446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c94b-b5d7-48a1-9261-7acab64e0712 None admin] PATH_INFO: `/v3/users/6c170f42d0b64464b5907af37238f8d0` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:00.510648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c94b-b5d7-48a1-9261-7acab64e0712 None admin] RBAC: Authorizing `identity:get_user(user_id=6c170f42d0b64464b5907af37238f8d0)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:00.512127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c94b-b5d7-48a1-9261-7acab64e0712 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:00.514138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 160/309] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:04:00 2022] GET /identity/v3/users/6c170f42d0b64464b5907af37238f8d0 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:00.519862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:00.554021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:00.626976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897a3d7-8a2d-4a68-bf1f-725750c590cf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:00.662145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af29ed-13c7-4e6c-ab1e-d51ec4e6047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:00.663036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af29ed-13c7-4e6c-ab1e-d51ec4e6047e None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:00.663325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af29ed-13c7-4e6c-ab1e-d51ec4e6047e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:00.663610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af29ed-13c7-4e6c-ab1e-d51ec4e6047e None admin] PATH_INFO: `/v3/system/users/6c170f42d0b64464b5907af37238f8d0/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:00.665134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af29ed-13c7-4e6c-ab1e-d51ec4e6047e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6c170f42d0b64464b5907af37238f8d0, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:00.666680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af29ed-13c7-4e6c-ab1e-d51ec4e6047e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:00.684826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 150/310] 10.222.0.46 () {58 vars in 1334 bytes} [Mon May 23 17:04:00 2022] PUT /identity/v3/system/users/6c170f42d0b64464b5907af37238f8d0/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:01.163983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619d233-ba83-4b66-a010-9cd80ac58ac0 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.164339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619d233-ba83-4b66-a010-9cd80ac58ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.164546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619d233-ba83-4b66-a010-9cd80ac58ac0 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.166085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 161/311] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:01.171615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.171909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.172189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.189254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:01.190436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:01.258563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 151/312] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:01.281543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619d233-ba83-4b66-a010-9cd80ac58ac0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:01.298315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:01.389815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619d233-ba83-4b66-a010-9cd80ac58ac0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:01.424675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:01.425408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.425695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.425973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.437824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:01.445911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:01.446834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:01.448924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 162/313] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:01.453209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:01.481787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:01.556591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9b078-a406-48f0-a244-51bf4e58e5d0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:01.591272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:01.592304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.592833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.593308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.594246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:01.594770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:01.596352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:01.605245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 152/314] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:01.610541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:01.681907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:01.711929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839c8f7-9395-4f5c-ad47-35242c075e2f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:01.746473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:01.747737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.748244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.748748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] PATH_INFO: `/v3/users/405190de0ea44748b885c14ed28b6ad5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.750151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] RBAC: Authorizing `identity:get_user(user_id=405190de0ea44748b885c14ed28b6ad5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:01.751841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:01.753711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 163/315] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:04:01 2022] GET /identity/v3/users/405190de0ea44748b885c14ed28b6ad5 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:01.759541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:01.853915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:01.866577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0453-9e5a-4c50-bd1a-eb25701156b6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:01.901141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:01.901801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.902090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.902365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.970711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:01.972137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:02.061008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:02.072877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 153/316] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:02.078718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:02.182246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398488-d36a-406b-a6b9-505f23bfa761 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:02.217296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd0364-c41b-4b5a-a054-0fb2ec60e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:02.218524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd0364-c41b-4b5a-a054-0fb2ec60e2cf None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.219008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd0364-c41b-4b5a-a054-0fb2ec60e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.219482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd0364-c41b-4b5a-a054-0fb2ec60e2cf None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.220964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd0364-c41b-4b5a-a054-0fb2ec60e2cf None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:02.222634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd0364-c41b-4b5a-a054-0fb2ec60e2cf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:02.225127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 164/317] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:02 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:02.231097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:02.334887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb4c4-5547-40e7-a3e7-a0732adc5819 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:02.374106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:02.374776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.375065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.375344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.376187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] RBAC: Adding query filter params (role.id=32158fa17dd24a27aa60e7f3a9fb806d, scope.project.id=969a2852273f47a3be56fa55ecc75dcf, user.id=405190de0ea44748b885c14ed28b6ad5) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:02.376500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:02.377995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b2ba7-6358-4130-b601-ce28c76fff59 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:02.384296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 154/318] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:02 2022] GET /identity/v3/role_assignments?user.id=405190de0ea44748b885c14ed28b6ad5&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=32158fa17dd24a27aa60e7f3a9fb806d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:02.463303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d723-6ad9-49d9-83c1-35e7184713c0 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.463931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d723-6ad9-49d9-83c1-35e7184713c0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.464432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d723-6ad9-49d9-83c1-35e7184713c0 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.466355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 165/319] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:02.478390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d69114-5c47-4a29-8ef3-b6fd36fb2e36 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.478891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d69114-5c47-4a29-8ef3-b6fd36fb2e36 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.478891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d69114-5c47-4a29-8ef3-b6fd36fb2e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.497439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e4d69114-5c47-4a29-8ef3-b6fd36fb2e36 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:02.498716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e4d69114-5c47-4a29-8ef3-b6fd36fb2e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:02.556379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:02.576586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 155/320] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:02.599367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d723-6ad9-49d9-83c1-35e7184713c0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:02.612276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:02.619973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f5dd-1844-4ac1-adae-3ab3aa1e8277 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.620464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f5dd-1844-4ac1-adae-3ab3aa1e8277 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.620996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f5dd-1844-4ac1-adae-3ab3aa1e8277 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.622601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 156/321] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:04:02.628426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.628763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.629042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.649450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:02.650668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:02.724514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 157/322] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:02.731409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d723-6ad9-49d9-83c1-35e7184713c0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:02.746326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:02.765181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:02.766301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.766617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.766973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.768158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:02.769774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:02.771497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 166/323] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:02.777155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:02.850095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061152ee-3aa8-40a6-8599-f07988fc8c10 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:02.857205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:02.863791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:02.881241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe9a9-d18a-442e-93ad-59a28d74a360 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:02.884100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f03fb-6e81-406b-92c3-1e8c4a59e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:02.884947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f03fb-6e81-406b-92c3-1e8c4a59e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.885227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f03fb-6e81-406b-92c3-1e8c4a59e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.885497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f03fb-6e81-406b-92c3-1e8c4a59e1b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.896557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f03fb-6e81-406b-92c3-1e8c4a59e1b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fa0f03fb-6e81-406b-92c3-1e8c4a59e1b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:02.904530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:02.905431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:02.906201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 158/324] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:02.907367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1a9a-8b5d-467d-9954-a69a2d5d66a6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.907658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1a9a-8b5d-467d-9954-a69a2d5d66a6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.907942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1a9a-8b5d-467d-9954-a69a2d5d66a6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.909351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 159/325] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:02.911554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac1a9a-8b5d-467d-9954-a69a2d5d66a6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:02.916542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b3162-1701-4503-9a15-457799b95d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:02.917257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b3162-1701-4503-9a15-457799b95d19 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.917536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b3162-1701-4503-9a15-457799b95d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.917809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b3162-1701-4503-9a15-457799b95d19 None admin] PATH_INFO: `/v3/groups` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.918496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b3162-1701-4503-9a15-457799b95d19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:02.920000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b3162-1701-4503-9a15-457799b95d19 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:02.934925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 167/326] 10.222.0.46 () {60 vars in 1134 bytes} [Mon May 23 17:04:02 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:02.936223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:02.936519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:02.936827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:02.954209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:02.955677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:03.036129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 168/327] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:03.045822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac1a9a-8b5d-467d-9954-a69a2d5d66a6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.059086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:03.088072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.089226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.089776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.090062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.091104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:03.091500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:03.093592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:03.103762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 160/328] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:03.109612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:03.137774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:03.149596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:03.179654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3bc31-3128-4a46-854b-4bea26a8f743 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.221741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.222576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.222862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.223141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.228076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2809b-f66f-4077-8b8b-95ed75e7267e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.236697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:03.246975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:03.248064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:03.248907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:03.251428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 169/329] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:03.257733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:03.269007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.269905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.270189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.270465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] PATH_INFO: `/v3/users/9b29d13640f04cbe9122ad4cba079080` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.271668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] RBAC: Authorizing `identity:get_user(user_id=9b29d13640f04cbe9122ad4cba079080)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:03.273174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:03.275082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 161/330] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:04:03 2022] GET /identity/v3/users/9b29d13640f04cbe9122ad4cba079080 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:03.281673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:03.376182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aa3af-710d-46cd-8572-83457c2b9588 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.401427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ccca-a26a-4fe0-aa19-677044b9c04a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.403227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:03.411979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:03.426476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.427252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.427535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.427811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.428565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:03.428926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:03.430333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:03.441118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 170/331] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:03.446752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:03.449948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.450895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.451193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.451471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] PATH_INFO: `/v3/system/users/9b29d13640f04cbe9122ad4cba079080/roles/32158fa17dd24a27aa60e7f3a9fb806d` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.455259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b29d13640f04cbe9122ad4cba079080, role_id=32158fa17dd24a27aa60e7f3a9fb806d)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:03.456704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:03.467611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 162/332] 10.222.0.46 () {58 vars in 1334 bytes} [Mon May 23 17:04:03 2022] PUT /identity/v3/system/users/9b29d13640f04cbe9122ad4cba079080/roles/32158fa17dd24a27aa60e7f3a9fb806d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:04:03.568038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5be1-017a-40dd-b082-8d0ce447996a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.608414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0db1-3be6-4a9f-a781-77d9dc6c4786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.609725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0db1-3be6-4a9f-a781-77d9dc6c4786 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.610198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0db1-3be6-4a9f-a781-77d9dc6c4786 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.610658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0db1-3be6-4a9f-a781-77d9dc6c4786 None admin] PATH_INFO: `/v3/users/6c170f42d0b64464b5907af37238f8d0` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.612184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0db1-3be6-4a9f-a781-77d9dc6c4786 None admin] RBAC: Authorizing `identity:get_user(user_id=6c170f42d0b64464b5907af37238f8d0)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:03.613904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0db1-3be6-4a9f-a781-77d9dc6c4786 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:03.616562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 171/333] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:04:03 2022] GET /identity/v3/users/6c170f42d0b64464b5907af37238f8d0 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:03.622737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:03.734805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6444b-79e7-4bed-a060-416998372183 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:03.771104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:03.771781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:03.772066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:03.772343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:03.773220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] RBAC: Adding query filter params (role.id=c1a812e032604c4683295a602c263e78, user.id=6c170f42d0b64464b5907af37238f8d0, scope.system=all) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:03.773542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:03.775030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0cb1-5fc7-414d-86e9-8ae780136549 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:03.790451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 163/334] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 17:04:03 2022] GET /identity/v3/role_assignments?user.id=6c170f42d0b64464b5907af37238f8d0&scope.system=all&role.id=c1a812e032604c4683295a602c263e78 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:05.414775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271764-b349-45f4-afd5-558ea3067eef None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:05.415349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271764-b349-45f4-afd5-558ea3067eef None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:05.415349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271764-b349-45f4-afd5-558ea3067eef None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:05.417081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 172/335] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:05.422904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:05.423353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:05.423468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:05.445596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:05.446814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:05.468200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:05.529094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 164/336] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:05.574090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271764-b349-45f4-afd5-558ea3067eef None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:05.660339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:05.720360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271764-b349-45f4-afd5-558ea3067eef None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:05.762361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:05.763202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:05.763484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:05.763755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:05.776943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:05.790206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:05.791356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:05.792174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 173/337] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:05.801875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:05.973632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485ab13-b0a9-4e91-a327-edc4fd1d8182 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:06.020919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:06.021607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.021891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.022168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.022938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:06.023250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:06.024664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922f436-2bdd-4876-97c3-45c8bc4610c7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:06.037096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 165/338] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:06.043143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:06.233833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75987-4cb6-44ef-a316-d3746f4daea0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:06.256284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:06.286452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:06.287503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.288001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.288484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.313873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26471-4e30-450b-86f9-fa15cf989ec8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.314210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26471-4e30-450b-86f9-fa15cf989ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.314445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26471-4e30-450b-86f9-fa15cf989ec8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.319840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 166/339] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:06.322229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754fdc-7d02-48a9-9009-fd8bf4e784d4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.322527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754fdc-7d02-48a9-9009-fd8bf4e784d4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.322818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754fdc-7d02-48a9-9009-fd8bf4e784d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.373649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4a754fdc-7d02-48a9-9009-fd8bf4e784d4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:06.374946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4a754fdc-7d02-48a9-9009-fd8bf4e784d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:06.376115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:06.378078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:06.398262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:06.495380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 167/340] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:06.497585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67280e3-23ba-4d0d-91a0-0a8049775c35 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.498096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67280e3-23ba-4d0d-91a0-0a8049775c35 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.498587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67280e3-23ba-4d0d-91a0-0a8049775c35 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.499808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 174/341] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:06.500626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 168/342] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:06.505145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:06.518844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.519434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.519920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.523460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:06.543533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:06.547254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:06.633655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 169/343] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:06.634986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:06.672147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191febfc-d6a9-4a9e-893a-fc1d28684f5f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:06.723320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb3f3b-661e-4da3-958a-5ae0246b4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:06.726291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb3f3b-661e-4da3-958a-5ae0246b4258 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.726801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb3f3b-661e-4da3-958a-5ae0246b4258 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.727279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb3f3b-661e-4da3-958a-5ae0246b4258 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.730534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb3f3b-661e-4da3-958a-5ae0246b4258 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:06.732374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb3f3b-661e-4da3-958a-5ae0246b4258 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:06.735318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 175/344] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:06 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:06.735589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:06.737450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918c61-e0fb-41e2-89e6-d78d9cd7490a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.738197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918c61-e0fb-41e2-89e6-d78d9cd7490a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.738667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918c61-e0fb-41e2-89e6-d78d9cd7490a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.740971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 176/345] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:06.742162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918c61-e0fb-41e2-89e6-d78d9cd7490a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:06.767034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce09f1c-9b4f-42fe-b3cc-72449b7fae1a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:06.821205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:06.823130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.824034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.824515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.838898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:06.849333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:06.850256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:04:06.851053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:06.853835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 170/346] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:06.854874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:06.877009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:06.881379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918c61-e0fb-41e2-89e6-d78d9cd7490a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:06.936630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c368-feff-4e37-91ba-b2e56689205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:06.937818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c368-feff-4e37-91ba-b2e56689205a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.938124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c368-feff-4e37-91ba-b2e56689205a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.938396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c368-feff-4e37-91ba-b2e56689205a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.961497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c368-feff-4e37-91ba-b2e56689205a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-5d67c368-feff-4e37-91ba-b2e56689205a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:06.970804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:06.971811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:06.972783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 177/347] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:06.977524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:06.977816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:06.978091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:06.999379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:07.000027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e803da8-5f31-4550-87ac-4d9118ced4aa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.000576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:07.051322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.052577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.052961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.053315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.057932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:07.061320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.063674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.065886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 171/348] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:06 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:07.066774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.100135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 178/349] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:07.101418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.185284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab61ca-018b-4fd0-8a22-3e7963fbb984 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.201485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:07.234149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.234832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.235117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.235402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.236151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:07.236460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.237810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02952249-661c-43fc-a5cb-d57cf8a02f44 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.237917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.246548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 172/350] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:07.247395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.284447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.287571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.288060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.288491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.289692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:07.290159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.291839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.303037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 179/351] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:07.304317 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.325987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:07.370096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851e6c7-d599-496b-b7d8-7e4bceba0b00 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.413319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.414223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.414583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.415209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.416387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=c1a812e032604c4683295a602c263e78, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:07.416826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.418970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.420646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174caf83-603b-4862-9b65-092b98f64f24 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.425201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 173/352] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=c1a812e032604c4683295a602c263e78 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:07.427057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.465010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.465948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.466359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.466699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.472505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:07.488750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:07.497458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:07.498482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 180/353] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:07.500326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.598470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89254c-d223-47f0-b155-4a3b5ea49ffc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.647287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:07.652487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856a1a9-9dc1-44d2-a464-fe56b07521fe None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.661279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.662573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.663120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.663642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] PATH_INFO: `/v3/users/9b29d13640f04cbe9122ad4cba079080` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.665613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] RBAC: Authorizing `identity:get_user(user_id=9b29d13640f04cbe9122ad4cba079080)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.667494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.669773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 174/354] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/users/9b29d13640f04cbe9122ad4cba079080 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:07.670943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.694277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.694277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.694589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.694589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.775851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:07.790731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.792295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.818417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec988-2571-4303-90ca-6154b0422849 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:07.861780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:07.863068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.863940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.864436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.865457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:07.865982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:07.868410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f314358-252f-4571-8011-ab43ac1695f1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:07.880813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 175/355] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:07.883196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb7078-18dd-4366-8efe-1b3676c241fe None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:07.883787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb7078-18dd-4366-8efe-1b3676c241fe None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:07.884315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb7078-18dd-4366-8efe-1b3676c241fe None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:07.887115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 176/356] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:07.888179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb7078-18dd-4366-8efe-1b3676c241fe None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.926385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 181/357] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:07.927315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:07.958489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.011705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb7078-18dd-4366-8efe-1b3676c241fe None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.035930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.044571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f51bb-bc90-4977-bd17-7f77e0223f99 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.051810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.052640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.053024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.053400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.054584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] RBAC: Adding query filter params (role.id=32158fa17dd24a27aa60e7f3a9fb806d, user.id=9b29d13640f04cbe9122ad4cba079080, scope.system=all) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:08.054720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.056419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9bd1d-d3b9-44cc-bea9-42ab3ab76d58 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.070791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 177/358] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/role_assignments?user.id=9b29d13640f04cbe9122ad4cba079080&scope.system=all&role.id=32158fa17dd24a27aa60e7f3a9fb806d => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:08.072645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.073123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.073623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.084568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a22a6-17b3-49a3-926a-35a856b6d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.085285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a22a6-17b3-49a3-926a-35a856b6d66b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.085577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a22a6-17b3-49a3-926a-35a856b6d66b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.085861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a22a6-17b3-49a3-926a-35a856b6d66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.094752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:08.096301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:08.165135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a22a6-17b3-49a3-926a-35a856b6d66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.166883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a22a6-17b3-49a3-926a-35a856b6d66b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.172517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 178/359] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:08.173740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.247491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.285245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.292439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 182/360] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:08.293952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac60215-547e-4648-b0f2-555255bc874d None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.294247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac60215-547e-4648-b0f2-555255bc874d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.294553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac60215-547e-4648-b0f2-555255bc874d None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.296101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 183/361] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:08.296911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac60215-547e-4648-b0f2-555255bc874d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.316671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d60cb7-6447-4da7-8b4e-75c6568bc826 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.375433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.376865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.377366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.377833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.379862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.381588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.383522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 179/362] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:08.384472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.418123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac60215-547e-4648-b0f2-555255bc874d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.462542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7a5e5-62a8-4223-bec3-5b99e726f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.463367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7a5e5-62a8-4223-bec3-5b99e726f021 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.463650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7a5e5-62a8-4223-bec3-5b99e726f021 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.463919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7a5e5-62a8-4223-bec3-5b99e726f021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.475979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7a5e5-62a8-4223-bec3-5b99e726f021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-6fd7a5e5-62a8-4223-bec3-5b99e726f021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:08.484265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:08.485212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:08.486019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:08.486632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 184/363] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:08.490791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.490791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.490791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.507477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91acd1-b987-4093-b760-be33e6db130a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.511320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:08.511320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:08.527257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.554784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.555657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.555942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.556216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.558627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.560141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.566758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 180/364] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:08.566758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.570193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.590906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 185/365] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:08.591990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.695825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945fd7-0c49-4655-95f6-29da2eb46290 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.710131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dbc8e-9a3c-4421-bb4f-8fbd3336a747 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.743548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.743548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.743548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.743548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.745231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.746345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.748483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 181/366] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:08.749298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.756777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.757758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.758265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.759205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.760177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:08.760709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.762338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.773129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 186/367] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:08.774204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.813881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.838196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:08.897159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f80573-f049-4ba6-874f-129004fd805b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.906542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa83de-7dd5-4553-88af-7da85fd4608b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.938179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.939419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.939964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.940538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.941980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.943679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:08.946108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.946915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.947143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.951405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.951532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 182/368] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:08.951532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.962321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:08.970779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:08.971672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:08.972470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:08.974227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 187/369] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:08.978494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.070495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e164276-fcd5-4d80-8362-36b7869b4287 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.093785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.096628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5245d5f-a9a2-4119-973d-77bb0777bef8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.108160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.122993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.123979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.124118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.124410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.125305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:09.127147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.128486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.138284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 183/370] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:09.138433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.140697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.141579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.142062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.142507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.224690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.226478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.274341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366e5e2-ed6a-4305-ad64-1467b3ac3bc9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.321924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.323130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.323596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.324056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.325091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=c1a812e032604c4683295a602c263e78, scope.project.id=969a2852273f47a3be56fa55ecc75dcf) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:09.325418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.327141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.334636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 184/371] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:09 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=c1a812e032604c4683295a602c263e78 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:09.335591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.367142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 188/372] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:09.373251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.389874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.434744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.507387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2cf65-ad38-4fee-855c-1331ad4497b7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.548211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.548932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.549217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.549551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.550963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:09.551282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.552852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.563229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 185/373] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:09.570793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f3b12-ec61-43f9-879b-7bcdfa5a08fe None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.574798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.639544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.640794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.641083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.641358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.646286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.648892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.650810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 189/374] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:09 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:09.656442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.744569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369772b-ac4c-4286-bb15-908566cd3ddf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.762853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.811146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed244e3-bd57-4264-94a6-31229779fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.811832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed244e3-bd57-4264-94a6-31229779fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.814242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed244e3-bd57-4264-94a6-31229779fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.814558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed244e3-bd57-4264-94a6-31229779fd25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.815678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.872151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a252c-0766-4c60-9c0d-cdf64ecce17a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.929916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed244e3-bd57-4264-94a6-31229779fd25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.932068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed244e3-bd57-4264-94a6-31229779fd25 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.935342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.936222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.936506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.940317 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.941798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.943338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.945501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 190/375] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:09 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:09.951456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.121455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 186/376] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:04:10.122904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c5c4b-ae5d-48e8-959d-7c8861843de4 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.123196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c5c4b-ae5d-48e8-959d-7c8861843de4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.123561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c5c4b-ae5d-48e8-959d-7c8861843de4 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.124853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 187/377] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:10.130665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.130959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.131243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.135479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d59a-8abf-452b-899d-2ffb34e03363 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.144178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:10.153550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:10.155778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:10.181940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.182870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.183577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.183866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.185053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=969a2852273f47a3be56fa55ecc75dcf) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:10.185379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:10.186866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:10.193089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 191/378] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:09 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:10.193975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.221056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:10.289928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 188/379] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:10.348051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5c4a-1dba-48e5-ac83-7aab13845c16 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.352461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.395261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.396841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.397135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.397411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] PATH_INFO: `/v3/projects/549ef6c44d2245c896f7c092456b7282` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.398872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] RBAC: Authorizing `identity:get_project(project_id=549ef6c44d2245c896f7c092456b7282)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:10.400478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:10.403058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 192/380] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:10 2022] GET /identity/v3/projects/549ef6c44d2245c896f7c092456b7282 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:10.409351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.508554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70001504-0351-44c1-9a7e-4c6b57b3d519 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.559523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.561097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.566888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.567395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.571396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:10.576122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:10.588964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:10.606421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:10.607472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:10.608248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:10.613197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 189/381] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:10.619278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.627393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6dd45-2777-4804-870b-6bffdf0be7e4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.689152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.690408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.690912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.691987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] PATH_INFO: `/v3/groups/29caaddfa94f475b9b7b37e983fa6804` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.705426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] RBAC: Authorizing `identity:get_group(group_id=29caaddfa94f475b9b7b37e983fa6804)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:10.708796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:10.711048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 193/382] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:10 2022] GET /identity/v3/groups/29caaddfa94f475b9b7b37e983fa6804 => generated 229 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:10.717851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.816178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f9f7-75f2-48c2-a8f9-2642b07132b8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.861239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf2a74-a739-43b4-b306-1a29bd17f940 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.884913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.885634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.885922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.886202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.886975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:10.887292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:10.888919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:10.905465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 190/383] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:10.906785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.907475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.907754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.908037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.908923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] RBAC: Adding query filter params (group.id=29caaddfa94f475b9b7b37e983fa6804, role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=549ef6c44d2245c896f7c092456b7282) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:10.909241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:10.910665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.912099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:10.930719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 194/384] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:10 2022] GET /identity/v3/role_assignments?group.id=29caaddfa94f475b9b7b37e983fa6804&scope.project.id=549ef6c44d2245c896f7c092456b7282&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:10.993481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:11.049517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944fb76-739d-48f4-90cb-fa6804aee75f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:11.098429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:11.099341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:11.099632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:11.099916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:11.101318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:11.102843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:11.104820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 191/385] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:10 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:11.110235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:11.114649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:11.235660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b551dd-c7ab-46a9-af94-c793643418f5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:11.278531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1925c1-b220-4d24-a8d2-9c4010e97e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:11.279401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1925c1-b220-4d24-a8d2-9c4010e97e7e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:11.279689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1925c1-b220-4d24-a8d2-9c4010e97e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:11.279968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1925c1-b220-4d24-a8d2-9c4010e97e7e None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:11.281212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1925c1-b220-4d24-a8d2-9c4010e97e7e None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:11.282712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1925c1-b220-4d24-a8d2-9c4010e97e7e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:11.284832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 195/386] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:11 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:11.293699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:11.416063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da23a-ca55-4a13-80dc-441577401fc4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:11.449908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:11.461506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785cb79-6632-49e4-a7ac-6559dc3318f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:11.462684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785cb79-6632-49e4-a7ac-6559dc3318f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:11.462982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785cb79-6632-49e4-a7ac-6559dc3318f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:11.463263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785cb79-6632-49e4-a7ac-6559dc3318f9 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/groups/950af24cb8eb484396129e19b98696df/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:11.469948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785cb79-6632-49e4-a7ac-6559dc3318f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c98dfc42b44f5f9c98f1717152a2dd, group_id=950af24cb8eb484396129e19b98696df, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:11.471443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785cb79-6632-49e4-a7ac-6559dc3318f9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:11.493076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 192/387] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 17:04:11 2022] PUT /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/groups/950af24cb8eb484396129e19b98696df/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:12.125515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771e94b-edca-4140-9302-e2c2007adb46 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.126013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771e94b-edca-4140-9302-e2c2007adb46 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.126013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771e94b-edca-4140-9302-e2c2007adb46 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.127650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 196/388] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:12.132768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.133171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.133353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.161748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:12.162988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:12.238600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0086c2-6010-4af8-b584-efac172bf5e9 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.238600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0086c2-6010-4af8-b584-efac172bf5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.238600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0086c2-6010-4af8-b584-efac172bf5e9 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.239310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 197/389] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:12.246130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.246760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.247243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.248662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 193/390] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:12.267968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:12.269536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:12.284013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:12.347585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 198/391] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:12.372575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:12.376850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:12.472388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646f70b-04a8-4e1b-b9ec-48f13ace8386 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:12.492483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:12.519246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:12.520124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.520414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.520743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.538124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:12.550161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:12.551149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:12.551920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 194/392] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:12.557284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:12.597498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401acf1-3497-4381-9a68-83fc618912a9 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:12.678613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:12.682349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.682854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.683342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.709251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:12.719561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:12.720512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:12.721327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:12.732097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 199/393] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:12.748870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b7a73-e2c1-4fcf-a880-13e78b9c1557 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:12.754825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:12.810461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:12.811428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.814427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.814898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.815837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:12.816282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:12.817931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d89f82-ff92-4530-91e6-a2da0e0f228a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:12.826014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:12.829231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 195/394] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:12.830690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646885f-2f81-4c5f-8df3-2229cd806b63 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.830998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646885f-2f81-4c5f-8df3-2229cd806b63 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.831280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646885f-2f81-4c5f-8df3-2229cd806b63 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.836672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 196/395] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:12.837484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646885f-2f81-4c5f-8df3-2229cd806b63 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:12.881049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0f526-d268-4471-8804-8aebd70a1558 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:12.884160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:12.923753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:12.924544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.924920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.925261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.926852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:12.926852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:12.928424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8365ba-85a9-4814-8b37-ccd76a107e36 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:12.940563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 200/396] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:12.941901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:12.942254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:12.942599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:12.964161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646885f-2f81-4c5f-8df3-2229cd806b63 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:12.967192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:12.968653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:13.007673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.008703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.009053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.009394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.010752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.012297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.014877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 197/397] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:12 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:13.016095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.046602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 201/398] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:13.047825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.109089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:13.139826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212557-3af0-4153-b056-a563ee8d4662 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.148404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:13.169764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629b13c-c790-4b39-9d44-910aa4003af0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.187598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.189304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.189731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.190165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.191542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.193966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.200977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 198/399] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:13 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:13.201683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.212997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.213876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.214160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.214439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.215654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.217239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.219352 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 202/400] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:13 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:13.220239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.325085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df7bc-4e02-40ed-a64f-f3c5aeebaa7d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.333168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9161c98-4382-4418-992e-23401bf7e727 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.356241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:13.373080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.373771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.374542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.374647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.374874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.375154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.375494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.375948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.377738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.379808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.382018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 203/401] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:13 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:13.383520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.386280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:13.395174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:13.396097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:13.396926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 199/402] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:13.397581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.439996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:13.503047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823130-5b8c-495b-8144-4ff5c2101df6 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.522245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19c674-2456-4579-baf2-42b88aa8d9bd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.547511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.549256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.549987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.550433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/groups/950af24cb8eb484396129e19b98696df/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.553519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c98dfc42b44f5f9c98f1717152a2dd, group_id=950af24cb8eb484396129e19b98696df, role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.555925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.559725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0283-befd-487c-b7b2-b44832f9e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.560874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0283-befd-487c-b7b2-b44832f9e8f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.561361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0283-befd-487c-b7b2-b44832f9e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.561792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0283-befd-487c-b7b2-b44832f9e8f0 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf/groups/950af24cb8eb484396129e19b98696df/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.564405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f0283-befd-487c-b7b2-b44832f9e8f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=969a2852273f47a3be56fa55ecc75dcf, group_id=950af24cb8eb484396129e19b98696df, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.566663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f0283-befd-487c-b7b2-b44832f9e8f0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.573352 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 204/403] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 17:04:13 2022] PUT /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd/groups/950af24cb8eb484396129e19b98696df/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:13.574476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.585067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 200/404] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 17:04:13 2022] PUT /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf/groups/950af24cb8eb484396129e19b98696df/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:13.676920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:13.753950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532483-d37c-4a63-9b65-3e7291ca1c41 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.818721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:13.819414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.819696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.819972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.820775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:13.821083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:13.822525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:13.836707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 205/405] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:13.841523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bcb12-2d6c-4d31-b59b-4f552c216154 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.842076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bcb12-2d6c-4d31-b59b-4f552c216154 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.842361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bcb12-2d6c-4d31-b59b-4f552c216154 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.842458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:13.844922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 201/406] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:13.854560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:13.854871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:13.855134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:13.883728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:13.885694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:13.965041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601e1f8-23ed-4399-b161-28f3ac9339f1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:13.986262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 202/407] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:13.987732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:14.005512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.006657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.007112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.007572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.009013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:14.009512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.010856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:14.013003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 206/408] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:13 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:14.025620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.036089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:14.133629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10dc1-c2a5-4bd7-942a-83ccafd7f717 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.164104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57992d2e-fcc8-4c09-98fd-a01b29fde3a2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.202189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.203073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.203354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.203627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.204825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:14.206299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:14.208310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 207/409] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:14.215074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.221576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.222399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.222682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.222957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.233607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:14.241401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:14.242294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:14.243081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 203/410] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:14.248679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.297049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:14.360933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4e19c-29e5-48b2-b7a5-a42d930c1595 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.372082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:14.394747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc44099-bd05-4661-8617-94af596852cf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.407567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7586d-a832-44cb-85e9-b6a3def884cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.409270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7586d-a832-44cb-85e9-b6a3def884cb None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.409735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7586d-a832-44cb-85e9-b6a3def884cb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.410418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7586d-a832-44cb-85e9-b6a3def884cb None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf/groups/950af24cb8eb484396129e19b98696df/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.413248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7586d-a832-44cb-85e9-b6a3def884cb None admin] RBAC: Authorizing `identity:create_grant(project_id=969a2852273f47a3be56fa55ecc75dcf, group_id=950af24cb8eb484396129e19b98696df, role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:14.414927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7586d-a832-44cb-85e9-b6a3def884cb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:14.431688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.432531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.432912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.433303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.433720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 208/411] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 17:04:14 2022] PUT /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf/groups/950af24cb8eb484396129e19b98696df/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:14.434193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:14.434606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:14.435682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f19b-b8f7-4367-86fe-94f5320296b9 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.436155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f19b-b8f7-4367-86fe-94f5320296b9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.436269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:14.436815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f19b-b8f7-4367-86fe-94f5320296b9 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.438917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 209/412] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:14.446355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.446782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.446984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.449477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 204/413] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:14.457738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.466570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:14.468092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:14.589426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 210/414] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:14.633038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.668000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0635aa-9591-4ab3-8407-cb739897b728 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.680360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:14.708624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.709518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.709804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.710083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] PATH_INFO: `/v3/groups/29caaddfa94f475b9b7b37e983fa6804` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.711311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] RBAC: Authorizing `identity:get_group(group_id=29caaddfa94f475b9b7b37e983fa6804)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:14.713078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:14.715028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 205/415] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/groups/29caaddfa94f475b9b7b37e983fa6804 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:14.722221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.741099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:14.750894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a690cd-86be-4b6a-9cae-b484f79fb87a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.800981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.802055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.802543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.803041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.813938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:14.822065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:14.823145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:14.824122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:14.826645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 211/416] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:14.832541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.894562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573183-08f7-41ef-9d1b-dcaabce99d9c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:14.941736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:14.942617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:14.942899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:14.943172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] PATH_INFO: `/v3/projects/549ef6c44d2245c896f7c092456b7282` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:14.947590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] RBAC: Authorizing `identity:get_project(project_id=549ef6c44d2245c896f7c092456b7282)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:14.949122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:14.953373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 206/417] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/projects/549ef6c44d2245c896f7c092456b7282 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:14.959271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:14.996934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:15.001582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9199d64-4f15-46a3-9ced-310ad47eb191 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:15.037713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:15.038805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:15.039303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:15.039772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:15.040816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:15.041316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:15.043438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:15.053896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 212/418] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:15.060145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:15.123672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:15.151639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fa46-0ae3-4086-b283-6a9c9ab77579 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:15.170191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d995-79e5-4c30-8ac5-eb13f5391620 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:15.214303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:15.215209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:15.215491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:15.215766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] PATH_INFO: `/v3/projects/549ef6c44d2245c896f7c092456b7282/groups/29caaddfa94f475b9b7b37e983fa6804/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:15.218129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=549ef6c44d2245c896f7c092456b7282, group_id=29caaddfa94f475b9b7b37e983fa6804, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:15.220019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:15.233011 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:15.235753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:15.236562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:15.236911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:15.247958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 207/419] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 17:04:14 2022] PUT /identity/v3/projects/549ef6c44d2245c896f7c092456b7282/groups/29caaddfa94f475b9b7b37e983fa6804/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:15.274910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:15.326413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:15.327939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:15.439437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 213/420] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:04:15.445162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:15.577471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a68ec-168c-4610-9f0a-e934b25628a4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:15.613184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644145f-2f93-4abb-9903-535932400397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:15.614068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644145f-2f93-4abb-9903-535932400397 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:15.614351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644145f-2f93-4abb-9903-535932400397 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:15.614630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644145f-2f93-4abb-9903-535932400397 None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:15.615834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644145f-2f93-4abb-9903-535932400397 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:15.617325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644145f-2f93-4abb-9903-535932400397 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:15.619392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 208/421] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:15 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:15.624826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:15.712786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:15.764996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319d1d-7fed-47b3-a6c5-fa07d28bf85e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:15.821509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491c581-3a4d-462a-a0d6-71b56260f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:15.822390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491c581-3a4d-462a-a0d6-71b56260f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:15.822673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491c581-3a4d-462a-a0d6-71b56260f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:15.822946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491c581-3a4d-462a-a0d6-71b56260f0b0 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:15.825403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491c581-3a4d-462a-a0d6-71b56260f0b0 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:15.826928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491c581-3a4d-462a-a0d6-71b56260f0b0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:15.828623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 214/422] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:15 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:15.834805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644145f-2f93-4abb-9903-535932400397 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:15.860365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:15.992353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644145f-2f93-4abb-9903-535932400397 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:16.041426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:16.042102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.042391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.042666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.043504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=c1a812e032604c4683295a602c263e78, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:16.043823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:16.045388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af37ee-ea3d-4e4c-ae05-0727a9098af8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:16.053159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 209/423] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:15 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=c1a812e032604c4683295a602c263e78 => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:16.361008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59896107-aa3b-48a4-b03b-d8fd3ac4d6a8 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.361525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59896107-aa3b-48a4-b03b-d8fd3ac4d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.361525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59896107-aa3b-48a4-b03b-d8fd3ac4d6a8 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.363112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 215/424] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:16.369306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6515b69-9ba2-4701-bb21-b955a0d30146 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.369934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6515b69-9ba2-4701-bb21-b955a0d30146 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.369934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6515b69-9ba2-4701-bb21-b955a0d30146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.388832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d6515b69-9ba2-4701-bb21-b955a0d30146 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:16.390067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d6515b69-9ba2-4701-bb21-b955a0d30146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:16.477047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 210/425] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:16.502767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59896107-aa3b-48a4-b03b-d8fd3ac4d6a8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:16.536508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2009d-2230-4a91-b18e-f0da26fbeb4e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.536996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2009d-2230-4a91-b18e-f0da26fbeb4e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.537381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2009d-2230-4a91-b18e-f0da26fbeb4e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.540343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 211/426] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:16.545067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.545360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.545646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.553487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:16.566678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:16.567878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:16.651082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59896107-aa3b-48a4-b03b-d8fd3ac4d6a8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:16.680765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 212/427] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:16.681753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:16.688575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:16.689416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.689698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.689966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.700490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:16.706673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:16.708286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:16.709225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:04:16.710007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:16.711083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 216/428] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:16.715875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:16.829987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cc24f-30e7-4f99-a2d5-32d2c4feb33d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:16.831984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f63a-ad9e-48b8-a8d0-416046892003 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:16.870538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:16.871325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.871707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.872067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.872897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:16.873011 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] RBAC: Adding query filter params (name=member) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:16.873285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:16.873748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:16.874037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:16.874315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:16.874700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:16.878229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:16.895510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 217/429] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:04:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:16.896384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:16.896571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:16.905281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:16.906180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:16.907402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 213/430] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:16.917650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:16.959552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.030281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c5f0-782c-495f-b37d-11028b226353 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.064356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d60fb-d3a4-4254-9e00-3cc6127d33fa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.077078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af122cf-1c16-446e-919c-5a29c653adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.077761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af122cf-1c16-446e-919c-5a29c653adff None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.078045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af122cf-1c16-446e-919c-5a29c653adff None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.078320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af122cf-1c16-446e-919c-5a29c653adff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.098898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.099572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.099858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.100134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.100912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:17.101226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.102667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d874f-6db1-4139-9e55-1217e341274f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.111275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 214/431] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:17.112368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b7f28-14a1-447f-875f-06932e0f7e94 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.112681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b7f28-14a1-447f-875f-06932e0f7e94 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.112960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b7f28-14a1-447f-875f-06932e0f7e94 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.114282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 215/432] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:17.118828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b7f28-14a1-447f-875f-06932e0f7e94 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.156198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af122cf-1c16-446e-919c-5a29c653adff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.157688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af122cf-1c16-446e-919c-5a29c653adff None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.176657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.205446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.231535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b7f28-14a1-447f-875f-06932e0f7e94 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.259182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 218/433] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:04:17.265103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.265752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.266028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.266540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.267200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.267487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.267796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.282638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:17.283823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:17.344997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.346472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.360631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 219/434] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:17.360631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.415832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.438400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.459621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1f9d-3399-4d96-9a43-87043d91de14 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.461841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 216/435] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:17.467298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.495446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.496346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.496629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.496896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.498104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.499590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.501298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 220/436] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:17.502055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.578440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127df61-ca8b-4abc-995e-cefec8d72681 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.603370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fba5e4-ce00-4378-9d03-01f7233a4f47 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.614950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.616065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.616487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.617017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.628822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:17.637518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:17.637960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:17.639006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:17.639957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:17.641066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.641066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.641066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] PATH_INFO: `/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.641066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] RBAC: Authorizing `identity:get_project(project_id=a2c98dfc42b44f5f9c98f1717152a2dd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.642005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.647288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 221/437] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/projects/a2c98dfc42b44f5f9c98f1717152a2dd => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:17.647288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.647588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 217/438] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:17.648813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.667930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.668390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.752284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e37fe-2268-4049-a34b-8e44b0a174bf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.756109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eddf61-273e-457b-8b9e-348c86a54cac None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.790034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.790722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.791009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.791285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.792042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:17.792349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.793791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.798231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.798933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.799755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.800087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.801295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.802623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 218/439] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:17.803238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.807459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.814097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 222/440] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:17.814097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.892661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.906443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:17.915580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32004a24-b250-4fd8-8b34-231af0446165 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.922765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c05a3-5c7b-4a9c-bc5b-af8e8b51475e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:17.950573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.951503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.951821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.952109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:17.953316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:17.954771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:17.956400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 219/441] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:17.956886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e517110-9e02-4496-a36e-5915e0ab09b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:17.957203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:17.957844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517110-9e02-4496-a36e-5915e0ab09b6 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:17.958131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517110-9e02-4496-a36e-5915e0ab09b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:17.958406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517110-9e02-4496-a36e-5915e0ab09b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.027540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e517110-9e02-4496-a36e-5915e0ab09b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.029213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e517110-9e02-4496-a36e-5915e0ab09b6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.059237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5e1f-d751-4887-af30-2084a44eec38 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.091883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.092552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.092866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.093144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.093979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=c1a812e032604c4683295a602c263e78, scope.project.id=969a2852273f47a3be56fa55ecc75dcf) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:18.094294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.095752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.101442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 220/442] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=c1a812e032604c4683295a602c263e78 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:18.102218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.116067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:18.120265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:18.145926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 223/443] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:18.147835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134584-d1d4-408b-8640-d88e57194eea None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.148861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134584-d1d4-408b-8640-d88e57194eea None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.149148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134584-d1d4-408b-8640-d88e57194eea None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.151340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 224/444] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:18.153495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134584-d1d4-408b-8640-d88e57194eea None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.219073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fa56d-518e-4d94-8ebd-7047033ee7cb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.258396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.259506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.259795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.260076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.260987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:18.261316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.262823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff83d0-cfd4-43eb-85df-d64306c7bc80 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.268829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134584-d1d4-408b-8640-d88e57194eea None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.277303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 221/445] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=a2c98dfc42b44f5f9c98f1717152a2dd&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:18.277303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.277303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.277303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.305168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:18.306530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:18.334485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.338078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.338078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.338078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] PATH_INFO: `/v3/projects/969a2852273f47a3be56fa55ecc75dcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.339420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] RBAC: Authorizing `identity:get_project(project_id=969a2852273f47a3be56fa55ecc75dcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.341027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.343409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 225/446] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/projects/969a2852273f47a3be56fa55ecc75dcf => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:18.349593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.408013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 222/447] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:18.413347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:18.432312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.436290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:18.466292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30b32-7257-4374-9098-c91d6d2ea580 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.506171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.506963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.507241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.507512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] PATH_INFO: `/v3/groups/950af24cb8eb484396129e19b98696df` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.508724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] RBAC: Authorizing `identity:get_group(group_id=950af24cb8eb484396129e19b98696df)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.510235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.511880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 226/448] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/groups/950af24cb8eb484396129e19b98696df => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:18.518284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.541996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70b80-c865-4f3e-b74e-2cb7e64d47fb None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.582552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.583585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.583970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.587101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.597263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:18.605102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:18.606193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:18.607101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 223/449] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:18.613071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.632273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe96cc-dd9b-47f2-99a5-1597a307d842 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.663621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:18.681699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.682922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.682922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.682922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.683418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] RBAC: Adding query filter params (group.id=950af24cb8eb484396129e19b98696df, role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=969a2852273f47a3be56fa55ecc75dcf) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:18.683724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.685535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.691895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 227/450] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/role_assignments?group.id=950af24cb8eb484396129e19b98696df&scope.project.id=969a2852273f47a3be56fa55ecc75dcf&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:18.692946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:18.736746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739646ea-0c29-41c7-84a0-49c997e9c98c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.773763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.774376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.774662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.774939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.775701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:18.776010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:18.777509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:18.787459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 224/451] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:18.793237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:18.906602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538eb3f-f5ae-4dd5-9c4c-1ed6c9df3f64 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:18.939602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:18.940265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:18.940550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:18.940854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:18.991907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:19.008554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:19.010260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:19.107928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 228/452] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:19.113554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:19.228622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5ee6-166e-4114-bef6-3a6c3d8d77ac None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:19.254191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:19.264416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674be6-064a-460f-b17e-57057893103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:19.265690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674be6-064a-460f-b17e-57057893103f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:19.265978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674be6-064a-460f-b17e-57057893103f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:19.266254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674be6-064a-460f-b17e-57057893103f None admin] PATH_INFO: `/v3/projects/549ef6c44d2245c896f7c092456b7282` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:19.267537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6674be6-064a-460f-b17e-57057893103f None admin] RBAC: Authorizing `identity:get_project(project_id=549ef6c44d2245c896f7c092456b7282)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:19.269044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6674be6-064a-460f-b17e-57057893103f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:19.270729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 225/453] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:04:19 2022] GET /identity/v3/projects/549ef6c44d2245c896f7c092456b7282 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:19.276972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:19.377509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:19.399166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb5de-5c58-4ea6-930e-e4da8948b01e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:19.441730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0086-209a-479e-b3ed-f4102eb9d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:19.442602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0086-209a-479e-b3ed-f4102eb9d22c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:19.442880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0086-209a-479e-b3ed-f4102eb9d22c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:19.443152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0086-209a-479e-b3ed-f4102eb9d22c None admin] PATH_INFO: `/v3/groups/29caaddfa94f475b9b7b37e983fa6804` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:19.444346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc0086-209a-479e-b3ed-f4102eb9d22c None admin] RBAC: Authorizing `identity:get_group(group_id=29caaddfa94f475b9b7b37e983fa6804)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:19.445843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc0086-209a-479e-b3ed-f4102eb9d22c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:19.447468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 229/454] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 17:04:19 2022] GET /identity/v3/groups/29caaddfa94f475b9b7b37e983fa6804 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:19.454144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674be6-064a-460f-b17e-57057893103f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:19.564399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674be6-064a-460f-b17e-57057893103f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:19.599516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:19.600160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:19.600448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:19.600750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:19.601583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] RBAC: Adding query filter params (group.id=29caaddfa94f475b9b7b37e983fa6804, role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=549ef6c44d2245c896f7c092456b7282) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:19.601895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:19.603340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897008-ba0b-4fee-b3dc-c2c1c64c1d52 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:19.609346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 226/455] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 17:04:19 2022] GET /identity/v3/role_assignments?group.id=29caaddfa94f475b9b7b37e983fa6804&scope.project.id=549ef6c44d2245c896f7c092456b7282&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:22.169498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09628d1e-396e-4224-b4a5-c499842d1d79 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.170052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09628d1e-396e-4224-b4a5-c499842d1d79 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.170052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09628d1e-396e-4224-b4a5-c499842d1d79 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.171684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 230/456] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:22.177416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.178243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.178742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.201625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:22.203234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:22.278257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:22.297903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5252-f56c-4456-938d-ff282c12c2cb None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.298194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5252-f56c-4456-938d-ff282c12c2cb None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.298479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5252-f56c-4456-938d-ff282c12c2cb None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.300159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 231/457] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:22.305280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.305429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 227/458] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:22.305923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.306411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.326742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:22.328319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:22.354107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:22.446359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 232/459] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:22.469081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce251d9d-1b55-4ca0-942f-da6c3e16a64c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:22.490940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:22.503277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:22.504333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.504796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.505242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.516637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:22.518401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:22.542286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:22.543561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:22.544795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:22.544795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:22.544795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:22.544795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:22.552746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 228/460] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:22.554493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:22.645104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:22.703918 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:22.739479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc962ffb-4161-4f94-9025-7ba82e753056 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:22.780324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34767a-5395-4691-843b-bdbbfb3f1dd5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:22.805937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:22.806777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.807063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.807342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.820486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:22.821520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.822487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:22.822960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.823421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.825137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:22.826206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:22.826710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:22.828295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9fc4-3a9e-4c3b-b52e-26cc002c5948 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:22.853256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 229/461] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:22.857694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c4c47-d295-4779-97c0-c09aebb3e5f4 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.858184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c4c47-d295-4779-97c0-c09aebb3e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.858616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c4c47-d295-4779-97c0-c09aebb3e5f4 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-557f37b3-7d9f-40a1-9ada-38ceb37a8301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:22.860464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:22.861314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:22.862182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:22.862182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:22.862182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:22.862182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:22.862666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 230/462] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:22.864691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 233/463] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:22.865692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c4c47-d295-4779-97c0-c09aebb3e5f4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:22.866766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:22.867251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:22.867709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:22.888141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:22.889590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:22.961931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 234/464] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:22.963336 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:22.984625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:22.985922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c4c47-d295-4779-97c0-c09aebb3e5f4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.020797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e62d4-cf70-42db-95db-4d89276919c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.021487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e62d4-cf70-42db-95db-4d89276919c5 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.021804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e62d4-cf70-42db-95db-4d89276919c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.022087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e62d4-cf70-42db-95db-4d89276919c5 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.022805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e62d4-cf70-42db-95db-4d89276919c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.024284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e62d4-cf70-42db-95db-4d89276919c5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.036130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:23.052633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 231/465] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:04:22 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:23.052633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cea0-a8e7-46a8-812d-6e61e7d8bdf5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.052633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cea0-a8e7-46a8-812d-6e61e7d8bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.052633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cea0-a8e7-46a8-812d-6e61e7d8bdf5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.052633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 232/466] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:23.052633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cea0-a8e7-46a8-812d-6e61e7d8bdf5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.090608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d86bc9-daae-43bb-9213-ee097c5f3852 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.138226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.139122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.140114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.140788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.141535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:23.141844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.144155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf901c-68b4-472d-8605-32698a72c923 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.160885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 235/467] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:23.166412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.166721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.166979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.180140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cea0-a8e7-46a8-812d-6e61e7d8bdf5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.193743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:23.195663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:23.220093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.222054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.222054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.222054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.236275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.240812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:23.264798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:23.266090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:23.266924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:23.266924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:23.266924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:23.266924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:23.266924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 233/468] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:23.266924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.285654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:23.298702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 236/469] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:23.299412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.368089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:23.404958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf857f1-55c4-4fbf-b92d-79faeb37ef35 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.432381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ebb7-9c82-4e79-b664-04c18aa7b8ca None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.442013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.442709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.442999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.443280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.444003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.445521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.468771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 234/470] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:04:23 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:23.469787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.471816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.472630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.472937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.473213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.474193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:23.474506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.475949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.490003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 237/471] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:23.506415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.549116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:23.594972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b52083-5da4-457c-bbd9-a89c1600818b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.641465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.642323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.642613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.643510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.660540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.662867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:23.703638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:23.704565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:23.705463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:23.705463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:23.705463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:23.705463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:23.707453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 235/472] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:23.714584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.759109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637c05-608d-446e-ae44-21aae659ab84 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.791204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:23.821972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.822909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.823398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.823866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.824806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.826586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.847809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd306e-6d52-4953-92a7-e4a8708397be None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:23.853808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 238/473] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:04:23 2022] POST /identity/v3/users => generated 249 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:23.882625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:23.907184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:23.908246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.908800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.909272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.910219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:23.910812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:23.912575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9f3ab-5be8-4609-836f-a04aa33b602f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:23.928548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 236/474] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:23.934885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:23.939630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2a6a-14fc-434c-bf81-23f5dfed947d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.939956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2a6a-14fc-434c-bf81-23f5dfed947d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.940239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2a6a-14fc-434c-bf81-23f5dfed947d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.942037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 237/475] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:23.951100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:23.951100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:23.951371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:23.969497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:23.970720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:24.064809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb42103-08c3-451d-9c05-53a30bae3a8b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:24.069533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 238/476] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:24.113069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:24.115560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:24.116266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:24.116559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:24.116925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:24.117656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:24.119290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:24.145365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 239/477] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:04:23 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:24.232437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c900fb-257d-4744-a341-aa4d691fd1b4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:24.241402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:24.274503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:24.275207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:24.275491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:24.275815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:24.276576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:24.278264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:24.286521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.sql.core [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 17:04:24.286521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 17:04:24.286521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [parameters: {'id': '0b4d13ae68bd41d0bda3fdf86bf96110', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 17:04:24.286521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80556) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application conn.query(q) May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result.read() May 23 17:04:24.305191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return ref.to_dict() May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:04:24.306142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application next(self.gen) May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application yield resource May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application next(self.gen) May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.session.rollback() May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.force_reraise() May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise self.value May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application session.commit() May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 17:04:24.307034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._prepare_impl() May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.session.flush() May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._flush(objects) May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application compat.raise_( May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application flush_context.execute() May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rec.execute(self) May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 17:04:24.307877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:04:24.308827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application conn.query(q) May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result.read() May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:04:24.309705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [parameters: {'id': '0b4d13ae68bd41d0bda3fdf86bf96110', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:24.310475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 17:04:24.311245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:24.312067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 239/478] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 17:04:24 2022] POST /identity/v3/roles => generated 144 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:24.313476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:24.368270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:24.452993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2133-2ee7-4fc9-892e-b9290d2eadcf None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:24.487795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679c88-5ba0-4eb8-a8f4-8af4354b3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:24.488651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679c88-5ba0-4eb8-a8f4-8af4354b3d91 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:24.488941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679c88-5ba0-4eb8-a8f4-8af4354b3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:24.489217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679c88-5ba0-4eb8-a8f4-8af4354b3d91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:24.499887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c679c88-5ba0-4eb8-a8f4-8af4354b3d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1c679c88-5ba0-4eb8-a8f4-8af4354b3d91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:24.508255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:24.509187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:24.509993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 240/479] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:04:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:24.515543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:24.624070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1633-5a6f-4af1-b59e-e7c126541907 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:24.664045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:24.664754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:24.665044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:24.665320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:24.666078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:24.666388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:24.667789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae24d-a4be-4576-bbc5-3740d6bf2120 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:24.676831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 240/480] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:25.666185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18209096-0a74-46d5-b7bb-fb25697b894b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:25.666703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18209096-0a74-46d5-b7bb-fb25697b894b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:25.666816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18209096-0a74-46d5-b7bb-fb25697b894b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:25.668365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 241/481] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:25.673991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:25.674833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:25.675305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:25.696967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:25.698190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:25.736831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:25.826434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 241/482] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:25.873222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18209096-0a74-46d5-b7bb-fb25697b894b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:25.994189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:26.022250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18209096-0a74-46d5-b7bb-fb25697b894b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:26.078001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390d449-a6ab-4fa3-9c56-cd86fc8ab2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:26.079263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390d449-a6ab-4fa3-9c56-cd86fc8ab2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.079744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390d449-a6ab-4fa3-9c56-cd86fc8ab2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.080253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390d449-a6ab-4fa3-9c56-cd86fc8ab2e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.091413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390d449-a6ab-4fa3-9c56-cd86fc8ab2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-2390d449-a6ab-4fa3-9c56-cd86fc8ab2e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:26.099725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:26.100730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:26.101528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:26.104389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 242/483] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:26.114027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:26.331299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589f7c-b7f4-4ace-ae36-72c5504e1c1c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:26.387755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:26.388452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.388766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.389052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.389809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:26.390122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:26.391878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:26.400189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536ff05-2c99-4bbc-ac96-c5c33407cd24 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.400821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536ff05-2c99-4bbc-ac96-c5c33407cd24 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.401293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536ff05-2c99-4bbc-ac96-c5c33407cd24 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.403082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 243/484] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:26.408898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 242/485] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:26.410374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.410878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.411344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.413190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:26.448580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:26.477667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:26.479038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:26.601623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185f779-0ea3-4e84-a013-d527a7327430 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:26.686047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:26.687711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.688193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.688731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.699779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 244/486] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:26.702523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:26.704311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:26.726258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:26.727174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:26.728021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:26.728021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:26.728021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:26.728021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:26.730324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 243/487] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:26.735671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:26.746047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:26.828583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:26.854632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1c33-2999-459b-9b93-928eda33c5f8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:26.911033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c4b65-5ec3-4ad0-86d8-acc91d8049b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:26.912214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c4b65-5ec3-4ad0-86d8-acc91d8049b4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.912752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c4b65-5ec3-4ad0-86d8-acc91d8049b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.913226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c4b65-5ec3-4ad0-86d8-acc91d8049b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.916900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:26.927327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c4b65-5ec3-4ad0-86d8-acc91d8049b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e32c4b65-5ec3-4ad0-86d8-acc91d8049b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:26.938049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:26.938929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:26.939743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:26.942757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 244/488] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:26.943710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7a5ec-ed84-4f24-a6b4-0605e608e442 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:26.944322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5773b-5d3a-49b2-982d-59cc7054ee5c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.944786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5773b-5d3a-49b2-982d-59cc7054ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.945220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5773b-5d3a-49b2-982d-59cc7054ee5c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.951786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 245/489] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:26.953204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5773b-5d3a-49b2-982d-59cc7054ee5c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:26.984713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:26.985586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:26.985987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:26.986363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:26.987225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:26.987640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:26.990751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccb99-21ee-40f7-b213-3a9f7ca56151 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.019322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 245/490] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:27.020281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.020570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.021041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.043865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:27.045456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:27.113839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5773b-5d3a-49b2-982d-59cc7054ee5c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.133102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 246/491] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:27.134270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.174023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.175445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.175943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.176183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.177032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:27.177353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.178759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.181216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.188623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 246/492] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:27.189450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.219649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.258084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884bc2-3cb9-4953-8f12-61244b7bd38c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.286927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eab25-0bab-4349-a99b-96f0be6d45bc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.293835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.294745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.295018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.295296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.303020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.304526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-2d99e8d7-da82-438f-8020-ecf9cfabf801 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:27.320478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:27.321713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:27.322627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 247/493] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:27.323213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531dc9e-9dfd-421c-bfa2-d522568433dc None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.323280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531dc9e-9dfd-421c-bfa2-d522568433dc None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.323555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531dc9e-9dfd-421c-bfa2-d522568433dc None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.324977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 248/494] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:27.329594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531dc9e-9dfd-421c-bfa2-d522568433dc None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.331922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.332954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.333409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.333693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.345156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:27.353024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:27.353917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:27.354733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 247/495] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:27.356095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.422624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.438288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531dc9e-9dfd-421c-bfa2-d522568433dc None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.465049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.468415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfefe8-50af-4722-a2bc-ef904b139e74 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.474678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.475501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.475791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.476071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.486254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.487754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.504031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.504749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.505030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.505301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-e289ed1c-6604-4de5-965d-0429355f1af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:27.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:27.506195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:27.507090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:27.507090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:27.507090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:27.507090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:27.507307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:27.507307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.507920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.511378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 249/496] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:27.512806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.513111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.513395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.533396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:27.534681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:27.551575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 248/497] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:27.552294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.614154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 250/498] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:27.615015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.671418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db198-f500-46bc-aaae-3f96469953f0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.689110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.712412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.713141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.713746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.714038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.714964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:27.715282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.717185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.724285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c3ec8-42b6-444d-bf69-4c8621ecec3d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.725487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 249/499] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:27.727223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.734214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.761017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.761698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.761987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.762267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.763023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:27.763334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.764794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.776909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 251/500] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:27.777705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.831253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d199ca-48d3-434d-b6bc-943f16b4441c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.864615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.865279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.865569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.865849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.881053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a605-8621-4cb3-8077-ebed484b4599 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:27.911822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:27.913530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02814f97-6acc-4666-84bb-9cd1924647aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:27.914335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814f97-6acc-4666-84bb-9cd1924647aa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.914634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814f97-6acc-4666-84bb-9cd1924647aa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.914906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814f97-6acc-4666-84bb-9cd1924647aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.924940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02814f97-6acc-4666-84bb-9cd1924647aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-02814f97-6acc-4666-84bb-9cd1924647aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:27.932982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:27.933972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:27.934816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:27.935416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:27.935494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 252/501] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:27.935561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:27.935626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f24a1-924f-4499-aa51-22b6d6347247 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:27.935972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f24a1-924f-4499-aa51-22b6d6347247 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:27.936118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f24a1-924f-4499-aa51-22b6d6347247 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:27.937541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 253/502] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:27.938152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f24a1-924f-4499-aa51-22b6d6347247 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:27.967463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.040206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 250/503] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:28.040206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.040453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f24a1-924f-4499-aa51-22b6d6347247 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.074022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.074829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.075178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.075528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.086305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.087806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:28.104470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:28.105382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:28.106225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:28.106225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:28.106225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.106225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:28.106225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 254/504] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:28.106556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.119805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.142864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621445e-82e0-4121-bccf-4017d497ebd5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.176875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.177685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.177970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.178245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.185364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.185869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.186892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8cf167be-e0f3-4687-9315-77d9cd094e26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:28.202802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:28.203889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:28.204870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 251/505] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:28.205427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.205676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.205962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.208249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2e714-d20c-4abb-a855-08a165eff30a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.222722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:28.223851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:28.241663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.242341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.242628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.242892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.243768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:28.244079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.245513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.253635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 255/506] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:28.254500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.289222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 252/507] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:28.290052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.355934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.372585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3105770-6ebb-46b7-8ebb-072c18b1ac74 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.391737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63549fd6-4d93-4a7b-8f11-55767d7ddf1d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.406277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.407093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.407375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.407648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.418556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.420046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.422225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.425604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.426284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.426567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.426859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.427578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:28.427965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.429309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:28.438870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:28.439848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:28.449518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:28.449518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:28.449518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.449518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:28.449518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 256/508] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:28.449832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 253/509] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:28.449906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.449983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.541859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfc88d-caad-4bac-9387-4c9519b2d5fe None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.546936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8c3e-c3fd-4a19-b2a2-12c309650f1e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.572023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.576619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.577321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.577604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.577884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.578725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:28.579036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.580506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.580674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.581400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.581684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.581962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.592147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.593653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:28.610302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:28.611222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:28.612063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:28.612063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:28.612063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.612063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:28.612063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 254/510] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:28.612822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.624974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 257/511] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:28.625836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.679082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.720414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d93b-ab14-4c5b-b9c2-eacace3cec3f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.724575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee0ec-18f7-4186-8beb-81df2a388347 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.758079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.758890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.759170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.759448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.763632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.764477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.764793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.765063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.771383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.772838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.772948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.774362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:28.789403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:28.790353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:04:28.791274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:28.791774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:28.793160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:28.794828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:28.794828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:28.794828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:28.794828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:28.795207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 258/512] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:28.795207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.795399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 255/513] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:28.795399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.829655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.895754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bd74-4e99-4c49-94ed-adc208ee5e86 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.897880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec24aa-b75c-40dc-8436-20d781eb81ad None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:28.909174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:28.930034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.930452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:28.930706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.930990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.931119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:28.931267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.931401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:28.931675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:28.931992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:28.932298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.932380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:28.932722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:28.933733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.934203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:28.944809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 259/514] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:28.950395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 256/515] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:28.950554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:28.950658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.052549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.062515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a9c9-17f6-4b51-94a2-7081c173d3f7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.062812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880f5e-c5c2-4c2d-af33-3fc9b93e70eb None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.097602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.098257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.098355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.098543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.098820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.098955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.099234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.099514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.100358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:29.100710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.102179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.119806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 257/516] 10.222.0.46 () {56 vars in 1139 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:29.120635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.140000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.167364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.168921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.219634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e707-6e91-41b6-a618-bb09c0b3a3e6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.253907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.254586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.254875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.255158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.255897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:29.256208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.257637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.267325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 260/517] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:29.267992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.270697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 258/518] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:29.271902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.284156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.352657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.372743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637b7a-c2f8-43e4-85d5-3c1d41065e8b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.381720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5ad7-e4dd-4a1e-bf4f-38acf3bd6a95 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.404936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.405747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.406030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.406306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.412735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.414200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.415842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.416690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.416981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.417260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.424499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.426014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:29.428595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:29.429440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:29.430288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:29.432748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 259/519] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:29.433734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:29.440850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:29.441763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:29.442625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 261/520] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:29.443163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.502638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.533662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f502c11-d49b-497b-8e9b-3e95c42830b7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.539604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28531e7-2ef3-4bda-beb9-3cb27dc190c3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.567707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.568377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.568693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.568969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.569158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.574364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.575213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.575492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.575758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.585664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.587168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:29.604984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:29.605997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:29.606924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:29.606924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:29.606924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:29.606924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:29.606924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 262/521] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:29.607183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.635391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.636946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.701788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.707478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bf477-1fd0-425d-b53f-34159c21afa6 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.736503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 260/522] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:29.737625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.740059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.740762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.741059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.741300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.742004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.743462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.763355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 263/523] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:04:29 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:29.764149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.826305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.857345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049c8e-569d-4e40-81f5-763947a18b7e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.896939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e147b-ca28-400b-b4a5-553d16adb195 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:29.898179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.898866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.899173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.899906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.900259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:29.900572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.902116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.926577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 261/524] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:29.926577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:29.940197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:29.940933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:29.941231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:29.941513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:29.942389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:29.942702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:29.944199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:29.956620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:29.964257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 264/525] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:29.968643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.035131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef1e4-aafd-4182-9e81-deebeca96b80 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.071642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.071921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.072326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.072859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.072964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.073722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:30.073964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.075900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.076458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c23ff-013a-49b3-a560-9fd1d60199c7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.092174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 262/526] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:30.092174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.116722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.117466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.117745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.118019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.129256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.130755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:30.151342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:30.152360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:30.153787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:30.153787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:30.153787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:30.153787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:30.153787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 265/527] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:30.157810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.188546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.199003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c3e31-5992-4d58-8dc3-633e8e8cbb2c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.232999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.233673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.234091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.234209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.235035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=12c6f9c481ec4108a86db440cc90311f) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:30.235356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.236867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.252639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 263/528] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/role_assignments?user.id=12c6f9c481ec4108a86db440cc90311f&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:30.252639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.274603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b386b58-9ba2-40d5-86c8-8bef936a0d1c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.312277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.313085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.313528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.313897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.335602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.385256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aafb4a-982a-4d5c-92c3-a1ff8f74278f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.394339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.396019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.433460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.435292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.435587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.435871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.445520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.448580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:30.470476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:30.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:30.472228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:30.476503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 264/529] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:30.477468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.494553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.526838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 266/530] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:30.527858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.582116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.602684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733d13d-5a64-4b00-859e-a3bc140cff44 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.643430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef06e6a-c699-4d14-ba17-16df856c87f2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.646676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.646907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.647150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.647444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.648179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:30.648496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.650132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.666131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 265/531] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:30.667327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.686444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.687126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.687410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.687686 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.688476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:30.688828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.690301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.708590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 267/532] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:30.709515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.771805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.804992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be95cc-2607-4954-8d93-d616181ad81b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.835662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6d5f-25eb-4ecf-9f36-4be444fb0be5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:30.839759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.840905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.841384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.841850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.848151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:30.854076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.855562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.878024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:30.878831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:30.879110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:30.879382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:30.881506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:30.882348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:30.883225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:30.883225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:30.883225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:30.883225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:30.885513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 266/533] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:30.886516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:30.888205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:30.890020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:30.906100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:30.907152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:30.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:30.909032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 268/534] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:30.909894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:31.002974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09be2ad-44e2-4d40-8d56-3136f5fae6a6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.037204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.037888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.038179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.038512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.039299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=49486e8648f34ebf82979c60ab45ff6b) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:31.039619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.041113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.041345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050580-daa1-43e8-b446-d47f8714d4d2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.045163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:31.052044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 267/535] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/role_assignments?user.id=49486e8648f34ebf82979c60ab45ff6b&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:31.052694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:31.092950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.094057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.094543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.095017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.096466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:31.097031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.099169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.116285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 269/536] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:31.121997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:31.153954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:31.182798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d3545-38ff-413c-a3e6-0d63ecec2934 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.233113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.233812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.234093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.234370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.235176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:31.235486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.237059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.243257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6b87-dd69-48bb-9ef2-e03b0130112b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.256789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 268/537] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:31.267184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:31.294756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.296786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.297075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.297353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.317643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.319181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:31.349809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:31.350739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:31.352146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 270/538] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:31.356741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:31.374585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:31.463043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd95b-1f62-4a34-a466-f25cd69e6546 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.512976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:31.527936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9cac-b628-4e4d-9fe1-9c7ebd701cd0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.536752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.537438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.537722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.537996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.538901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=9584ad1287d346f89ef31dd00dc1609c) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:31.539265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.540931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.552102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 269/539] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:31 2022] GET /identity/v3/role_assignments?user.id=9584ad1287d346f89ef31dd00dc1609c&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:31.587087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.587697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.588042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.588366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.589229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:31.589531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.591135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800989a-ce95-401c-9195-44bdac274a14 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.614384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 271/540] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:31.620074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:31.745405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9499c3-03cb-4a67-baa9-a530757fdac3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:31.761280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:31.793436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:31.794291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:31.794502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:31.794777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:31.795668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=d7460f33e2f74a1e86b76eab550b7c79) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:31.795982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:31.797527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f036c4-b655-47c2-8aad-60cf2055ccad None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:31.804425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 270/541] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:31 2022] GET /identity/v3/role_assignments?user.id=d7460f33e2f74a1e86b76eab550b7c79&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:32.245333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8a4e-e01f-44c7-adb3-3b754b529293 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.245861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8a4e-e01f-44c7-adb3-3b754b529293 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.245861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8a4e-e01f-44c7-adb3-3b754b529293 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.247327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 272/542] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:32.256160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.256439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.256769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.277124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:32.278415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:32.371260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 271/543] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:32.404344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8a4e-e01f-44c7-adb3-3b754b529293 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:32.540666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8a4e-e01f-44c7-adb3-3b754b529293 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:32.575583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85768b-f61a-4d4e-9e2e-8edb809d74dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:32.576410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85768b-f61a-4d4e-9e2e-8edb809d74dc None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.576733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85768b-f61a-4d4e-9e2e-8edb809d74dc None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.577012 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85768b-f61a-4d4e-9e2e-8edb809d74dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.588067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85768b-f61a-4d4e-9e2e-8edb809d74dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-6f85768b-f61a-4d4e-9e2e-8edb809d74dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:32.595862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:32.596786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:32.597809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 273/544] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:32.602944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:32.724695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e8e0-704f-4a89-ba52-7cd2a4e4bdf5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:32.734172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:32.748194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85f0c-11ab-4ea1-889c-34b0d2b745d8 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.748503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85f0c-11ab-4ea1-889c-34b0d2b745d8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.748791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85f0c-11ab-4ea1-889c-34b0d2b745d8 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.750397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 274/545] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:32.764494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.764494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.764494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.768632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:32.768632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.768632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.768632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.769274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:32.769274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:32.769544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:32.777681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 272/546] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:32.784742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:32.808518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:32.809846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:32.818938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:32.943551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57be16-9b31-41e8-83e6-aa0cd43688a2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:32.966295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 275/547] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:32.984176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:32.985030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:32.985471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:32.985758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:32.988522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.005054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.006710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:33.034077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:33.034979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:33.036858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:33.036858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:33.036858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:33.036858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:33.036858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 273/548] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:33.045610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.087537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:33.089975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92b0ea-662f-4626-bbdc-49c01455b548 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.134255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.135134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.135419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.135700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.150342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:33.155090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:33.163185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:33.164628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:33.166125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 276/549] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:33.170468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.239110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdfb53-da47-4f73-9fb6-e0fb7755603c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.313399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.314096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.314385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.314667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.315450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:33.315720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.317177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.328802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8aa96-4ab7-48f8-bb04-9cf3993de05e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.339962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 274/550] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:33.345298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.374102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.375201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.375742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.376212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.377204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:33.377708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.379537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.398455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 277/551] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:33.404051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.473500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:33.494630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ee9e7-dbc7-4493-96a7-c03e46f48324 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.523015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:33.553260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.554129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.554434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.554717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.570553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.572374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.580244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b3e89-f856-45cb-8dad-cbc4f4db133f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:33.598026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:33.599057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:33.600077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:33.602805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 275/552] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:33.617032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.643414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.644227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.644507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.644828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.657789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.659853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-649b6c18-0bcb-4a62-9ccd-b84871b054de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:33.681187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:33.682091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:33.683539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:33.683539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:33.683539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:33.683539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:33.683539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 278/553] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:33.684037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e34e2d-7240-4a3f-8c48-3913be45a4a4 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.684440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e34e2d-7240-4a3f-8c48-3913be45a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.684759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e34e2d-7240-4a3f-8c48-3913be45a4a4 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.688669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 279/554] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:33.691234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e34e2d-7240-4a3f-8c48-3913be45a4a4 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.754208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18430df-1f09-4f66-8b3f-a159bd406972 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.800882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.801581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.802011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.802305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.803274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:33.803596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.805860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfed7-d871-49e6-8b23-c2e699f855ee None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.824711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e34e2d-7240-4a3f-8c48-3913be45a4a4 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:33.825006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:33.831330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 276/555] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:33.833108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.833532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.833910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.844280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:33.861437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:33.863374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:33.868906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:33.869769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:33.870217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:33.870630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:33.871597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:33.872069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:33.874143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:33.891124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 280/556] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:33.892504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:33.960631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 277/557] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:33.960631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.021445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e1ca-32e2-410a-9f76-0e17d4a38338 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.056997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.057664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.057950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.058231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.092841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ca410-7952-4658-a93b-853fa58ff639 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.105824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.134526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.139048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.141086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.143497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.145310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.145599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.145887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.157873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.160244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:34.179837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:34.181357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:34.182305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 278/558] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:34.184317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.267497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 281/559] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:34.268794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.304269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432ffa-723c-4c9b-bd6e-d13527bef6ee None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.343499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.344339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.344644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.344926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.355545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:34.363411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:34.364412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:34.365266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 279/560] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:34.365947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.371857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.402158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443a15-c3d5-428b-b693-022edd3ece2f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.421418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.439443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.440125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.440409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.440708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.441561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:34.441923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.443472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6055ce-211e-489d-b3a3-2ff74f24b09d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.460643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 282/561] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:34.462038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ecf8f-5538-46ec-ad62-42eb5239b59f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.462332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ecf8f-5538-46ec-ad62-42eb5239b59f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.462911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ecf8f-5538-46ec-ad62-42eb5239b59f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.465559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 283/562] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:34.465559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ecf8f-5538-46ec-ad62-42eb5239b59f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.486755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895626-766d-4a68-b2c1-7961234309cf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.521963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.522775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.523061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.523336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.533709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.535316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:34.553496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:34.554608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:34.555498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:34.555498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:34.555498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:34.555498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:34.555498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 280/563] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:34.555779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.572165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ecf8f-5538-46ec-ad62-42eb5239b59f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.604176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.609721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103b37-6599-414a-baf7-42615129f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.610404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103b37-6599-414a-baf7-42615129f2da None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.610684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103b37-6599-414a-baf7-42615129f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.610956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103b37-6599-414a-baf7-42615129f2da None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.611707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103b37-6599-414a-baf7-42615129f2da None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:34.612013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103b37-6599-414a-baf7-42615129f2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.613439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103b37-6599-414a-baf7-42615129f2da None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.621548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 284/564] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:34.622707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebedd8-2285-4b81-ae4b-bc8b798ff2da None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.622993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebedd8-2285-4b81-ae4b-bc8b798ff2da None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.623269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebedd8-2285-4b81-ae4b-bc8b798ff2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.639197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0bebedd8-2285-4b81-ae4b-bc8b798ff2da None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:34.640797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0bebedd8-2285-4b81-ae4b-bc8b798ff2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:34.663883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d84c-8617-454a-a05f-08b8f8c58d23 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.665360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.699620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.700475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.700796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.701078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.706265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 285/565] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:34.707982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6173bbd-1d86-4a5c-8990-49ac2fe41f29 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.708275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6173bbd-1d86-4a5c-8990-49ac2fe41f29 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.708555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6173bbd-1d86-4a5c-8990-49ac2fe41f29 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.710381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 286/566] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:34.710906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6173bbd-1d86-4a5c-8990-49ac2fe41f29 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.715653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.717174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:34.734759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:34.735934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:34.737357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:34.737357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:34.737357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:34.737357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:34.737357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 281/567] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:34.737357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.830212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6173bbd-1d86-4a5c-8990-49ac2fe41f29 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.837177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbdc9-7f92-4d0d-b109-79386b35302e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:34.854185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.867820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.868508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.868832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.869114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.869844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:34.870147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.871557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725d5c9-a953-4e5a-85e3-d18b6487f975 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.871746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:34.872591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.872903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.873180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.883302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 287/568] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:34.883963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:34.884514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:34.884837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:34.885122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:34.885460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:34.902381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:34.903466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:34.904365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:34.905495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:34.905495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:34.905495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:34.905495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:34.905941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:34.906030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 282/569] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:34.906987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:34.915964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:34.972172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 288/570] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:34.973060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.008384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d50e-71ee-4856-b272-b2dde65e5bc2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.041320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.042131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.042419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.042729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.052909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:35.060657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:35.061703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:35.062553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 283/571] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:35.063275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.077262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0f56-2976-4217-9f33-b54dbfe4d6b2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.091348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.111475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.112150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.112435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.112747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.113474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:35.113791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.115208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.125595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.126438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 289/572] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:35.127216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.160820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66cd32-bfec-4d40-9385-ab416785e39d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.193908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.194655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.194934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.195205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.201808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.203294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:35.217395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:35.218328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:35.219433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 284/573] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:35.220326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.226724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d06f-6e23-4e50-a308-ef7748579d62 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.261384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.262051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.262365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.262643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.263360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:35.263663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.265105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.277239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 290/574] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:35.278102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.311735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.315827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90c4f1-4afd-4c88-8d82-d60f8ce245ac None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.342297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.351603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.352424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.352741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.353063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.366453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:35.375605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:35.376659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:35.377495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:35.380744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 285/575] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:35.381776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.384988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e1a33-31df-4794-8ed9-20403cf18ce9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.418494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.419215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.419504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.419782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.420527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:35.420863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.422256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.430073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 291/576] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:35.430852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.484236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6942-3f35-4e26-a64d-fed151db39cc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.517532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.518354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.518643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.518923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.523314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.526024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.527624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.529668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8da6-9943-4d7a-8be8-3ef4794a52c5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:35.542561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:35.543714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 286/577] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:35.549716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.571098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.571792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.572075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.572351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.573162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:35.573458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.574983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.587683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 292/578] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:35.588492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.596314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.649388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603c8b-295f-46b5-bc24-f32e15013eaf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.683005 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.683823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.684117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.684434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.686606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff197-7452-4f3a-8565-6986fccdbf3c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.691668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.693190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:35.707884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:35.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:35.709799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 287/579] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:35.710423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.727622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.728831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.729362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.729738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.730504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:35.730817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.732313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.742500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 293/580] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:35.743438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.767128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.816945 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3dab1-2341-4bb8-ab82-0fa8bc3fb5b1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.824213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.848107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7ddbf-e38e-4ebb-843d-0819262a3c51 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.850058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.850872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.851155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.851431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.861364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.862863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:35.881915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:35.882953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:35.883822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:35.883822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:35.883822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:35.883822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:35.884040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:35.884138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 288/581] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:35.884216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:35.884216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:35.884216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:35.884406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.884482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:35.885055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:35.886282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:35.899672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 294/582] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:35.900756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:35.975774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:35.985489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1bd7b-a646-485e-9f35-fb2bfa807da1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:35.997894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760181f-e7f6-43a8-829b-31fcd4acbf7c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.019233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.019894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.020200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.020455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.021312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=8a4c03a473c84329a4d982ef47ea0e52) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:36.021625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.023087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.029170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 289/583] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/role_assignments?user.id=8a4c03a473c84329a4d982ef47ea0e52&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:36.029944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.033977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.033977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.034268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.034520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.035384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:36.035692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.037227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.056886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.070845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 295/584] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 17:04:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:36.070845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.148701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0f408-0a0a-42bd-a8ad-54731e843a34 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.187625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.188110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592134b3-c9ae-4847-885e-bdd1a9618176 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.188462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.188782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.189071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.203730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.205290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:36.223570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:36.224758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:36.225840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:36.225840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:36.225840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:36.225840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:36.228449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.229247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.229620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.230064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.230175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 290/585] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:36.230915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.231054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:36.231472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.232994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.235680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.246472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 296/586] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:36.247334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.320017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.345680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898a0f-fb63-4c3a-86d3-633fc3e15ed6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.348552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b6ec1-0f2f-4969-9cb9-5949f403408c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.382806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.383725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.383897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.384259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.384542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/12c6f9c481ec4108a86db440cc90311f/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.384730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.385000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.385533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.396779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.398270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.400884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=12c6f9c481ec4108a86db440cc90311f, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.402452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.420631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 291/587] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:04:36 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/12c6f9c481ec4108a86db440cc90311f/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:36.420631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:36.420920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:36.421770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:36.422664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:36.422664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:36.422664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:36.422664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:36.422664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 297/588] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:36.422664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.482015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.548554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec019-1f57-4e7d-a17a-881f75816db8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.555557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463994a5-72d0-41f7-b51c-b0295cc786c9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.582497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.595277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.596044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.596253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.596555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.597318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:36.597637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.599424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.605331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.606600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.607825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.608310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.613686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 292/589] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:36.614642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.620079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.621976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:36.641537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:36.642535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:36.643530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 298/590] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:36.644109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.740386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7439355-00d6-4551-955c-ebe84093729f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.762795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757824f8-d72e-43f6-8f25-d85080bf9aa8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.772568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.779656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.780749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.781332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.781802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.782750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:36.783671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.785324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.801303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 293/591] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:36.806964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.807136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.808051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.808406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.808787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.818030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.819906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:36.835113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:36.836070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:36.837182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 299/592] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:36.838556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:36.868257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:36.940937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f740-94a4-40d4-af94-2fa5d115c185 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.946269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598ee6-7e37-45b5-ba76-a17dd1abfd3c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:36.981470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.982334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.982599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.982880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.983767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:36.984829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:36.985337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:36.986077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:36.987194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:36.987698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.989690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:36.990034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:36.991499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.009229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 294/593] 10.222.0.46 () {56 vars in 1139 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:37.009416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:37.010233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:37.011098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:37.012964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.019896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 300/594] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:37.019896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.051854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.133288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60730-86ca-4d38-890e-9101a3e75acd None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.147837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c80b53-48da-4c75-a713-66e677571bb6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.150273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.186627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.187765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.188046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.189221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.190121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.190609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.191071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.192100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:37.192633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.194302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.200584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.202405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.215381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 295/595] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:37.216548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:37.226396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:37.227322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:37.228173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:37.228173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:37.228173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:37.228173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:37.228173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 301/596] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:37.232810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.328517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852eb6a-2a72-4173-b87e-76aa5de5636e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.330566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.351245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f492-6339-4e78-a1ea-f28586c2c99e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.365145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.366143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.366598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.367041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.368113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:37.368651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.370321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.387808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 296/597] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:37.387808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.390572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.391473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.391832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.392241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.402910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.404644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.413157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:37.422926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:37.423832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:37.424805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:37.424805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:37.424805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:37.424805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:37.424805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 302/598] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:37.425512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.497988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5de3-d0f6-406f-b16e-2cbb21c0e6ee None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.532039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9584a1-ef7b-4fb2-95e1-e476ccc99797 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.533717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.534673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.535099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.535529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.536402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:37.536877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.538465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.554040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 297/599] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:37.555145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.568286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.573848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.575130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.575486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.576060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/49486e8648f34ebf82979c60ab45ff6b/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.594184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=49486e8648f34ebf82979c60ab45ff6b, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.595955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.616639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 303/600] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:04:37 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/49486e8648f34ebf82979c60ab45ff6b/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:37.616639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.679089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.716628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985ed6-ef2f-40a4-8ff8-fd656397394c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.730278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e6fd-1f06-40fa-837e-f7fb8021143e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:37.773139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.773139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.773139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.773139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.786767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.787764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:37.788511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:37.788856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:37.789141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:37.793031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:37.793031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:37.793265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.796307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:37.823808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 298/601] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:37.824549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:37.825521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:37.826386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 304/602] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:37.831832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.833688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:37.900473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:37.975373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c5000-4980-41b0-bd8a-7d7aa73090de None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:38.011469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:38.012068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83362f-c462-454c-8334-284a5953f9b9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:38.012179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.012466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.012780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.013584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:38.013898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:38.015778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:38.029570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 305/603] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:38.035215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:38.057018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:38.058179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.058638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.059085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.069231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:38.071201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:38.074912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:38.090824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:38.091751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:38.092668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:38.098479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 299/604] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:38.105610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:38.162954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047e29-56b2-4505-946d-4c8d6ab481b8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:38.165167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:38.207402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:38.209274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.209755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.210223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/9584ad1287d346f89ef31dd00dc1609c/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.228229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=9584ad1287d346f89ef31dd00dc1609c, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:38.230202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:38.250617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 306/605] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:04:38 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/9584ad1287d346f89ef31dd00dc1609c/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:04:38.294954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1392bb-a48c-44ef-9c9e-1842f62b552f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:38.333972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:38.335318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.336053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.336572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.337672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:38.338007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:38.339499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b797a1-6cdd-47fb-ad7b-35841ebba351 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:38.362988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 300/606] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:38.369134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:38.400662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aa80a-8aed-46f8-bcd4-5355b2938647 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.400662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aa80a-8aed-46f8-bcd4-5355b2938647 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.400662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aa80a-8aed-46f8-bcd4-5355b2938647 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.400987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 301/607] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:38.406720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.407011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.407291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.469826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:38.471082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:38.521958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6cc50-bdc0-4461-b762-3b284af67e75 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:38.590524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bec0e-4fb5-4ccf-840b-8d23705357f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:38.592082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bec0e-4fb5-4ccf-840b-8d23705357f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.592813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:38.593901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bec0e-4fb5-4ccf-840b-8d23705357f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.594414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bec0e-4fb5-4ccf-840b-8d23705357f6 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/d7460f33e2f74a1e86b76eab550b7c79/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.610438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 302/608] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:04:38.619639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bec0e-4fb5-4ccf-840b-8d23705357f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=d7460f33e2f74a1e86b76eab550b7c79, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:38.621448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bec0e-4fb5-4ccf-840b-8d23705357f6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:38.633192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:38.638452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 307/609] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:04:38 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/d7460f33e2f74a1e86b76eab550b7c79/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:38.738323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7b0e9-f136-4793-8f9c-2c6682a68c09 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.738614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7b0e9-f136-4793-8f9c-2c6682a68c09 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.738892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7b0e9-f136-4793-8f9c-2c6682a68c09 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.740286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 308/610] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:04:38.746095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.746809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.747276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.764966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:38.776556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:38.777731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:38.805489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248e61-a594-40b9-98e0-2c1b3433f4ab None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:38.891643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:38.892469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:38.892788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:38.893063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:38.909361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:38.917604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:38.918641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:38.919512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:38.924691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 303/611] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:38.926306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:38.929098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 309/612] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:38.952830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:38.981196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.053539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee9547-99de-4693-b972-757992b6f529 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.098335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d8ab-0f46-4417-ac0d-14a9e5f0724f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.130222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.136811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.137990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.138477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.138597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.139115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.139227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.139502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.139782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.141079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:39.141403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.142856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.160622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 304/613] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:39.161492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:39.166585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:39.181263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:39.182271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:39.183102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:39.185942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 310/614] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:39.191853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.330288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f26a-893d-4469-8e17-093ffb328ee0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.347864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9bba-b242-4f4f-ae12-05cdd6ea2a67 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.367683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.368034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.369153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.369450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.369734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.376726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:39.376726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.376726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.383134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 311/615] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:39.396924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.413169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.413993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.414279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.414557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.436813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.438299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:39.470585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:39.471540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:39.472400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:39.472400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:39.472400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:39.472400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:39.477491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 305/616] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:39.478363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.504780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.566938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6ee2e-f2b5-4874-b943-4d2ca0c613de None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.614490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.615337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.615630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.615909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.631832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b049d9-c19a-4b30-a0a0-af27746f7202 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.640885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.642213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:39.671487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:39.672439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:39.673349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:39.673349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:39.673349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:39.673349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:39.676716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 312/617] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:39.678531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.679934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.680882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.681376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.681872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.682828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:39.683340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.685045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.708083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 306/618] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:39.713778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.739317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.797069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd8eb8-d258-495a-8ce9-2e4a445f5f0d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.814183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.816223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58413-540a-4006-8c18-99815850ea25 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:39.850965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.852298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.852826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.853402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.861082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.862781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.873365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:39.873999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:39.874294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:39.874582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:39.875320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:39.875633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:39.877061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:39.879597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:39.880505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:39.881472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:39.884025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 307/619] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:39.889712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.900731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 313/620] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:39.904257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:39.985262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:39.995821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5614-42aa-4776-8c6a-145baf8d45ef None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.034114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.035196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.035680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.036160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.037241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:40.037757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.039420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.058986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 308/621] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:40.064860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:40.172814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34153b-5162-4311-b2fe-d17560352d4f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.210709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.211936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.212431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.213073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.224441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.226448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.235765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:40.246287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:40.247420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:40.248301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:40.248301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:40.248301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:40.248301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:40.248301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 309/622] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:40.253975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:40.275462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a68798-b498-4838-9df6-978c8f7b227c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.325514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.326787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.327354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.327856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.345460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.347376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.368069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f702-2d4f-4271-a4f1-1cf0f76b1ff2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:40.377924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:40.378876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:40.379853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:40.382736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 314/623] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:04:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:40.388016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:40.406037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.406037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.406037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.406037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.406442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:40.406442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.407036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.419595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 310/624] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:40.425280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:40.443807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:40.496137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:40.569805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6989c4e-441b-457a-a871-cc4e7d68ac98 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.573054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa078d-296b-41f2-a318-ac855e8eb847 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.633972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.634819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.635107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.635393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.640056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.641146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.641437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.641714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.642578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:40.642891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.644380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de988a8-652e-4764-890e-896d7161b62d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.651802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.653436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:40.668504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:40.669606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:40.670489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:40.671632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 315/625] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:04:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:40.673243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b0581-1cf7-4c26-867b-860c25a84dff None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.673763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b0581-1cf7-4c26-867b-860c25a84dff None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.674236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b0581-1cf7-4c26-867b-860c25a84dff None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.674519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 311/626] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:40.675800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:40.676454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 316/627] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:40.681479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b0581-1cf7-4c26-867b-860c25a84dff None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:40.782348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06831edd-7a01-4621-927f-1590e0ca5fc1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.788996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:40.798506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:40.802591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b0581-1cf7-4c26-867b-860c25a84dff None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:40.823441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3e3fb-ef9b-4063-a29e-b461e785bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.824117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3e3fb-ef9b-4063-a29e-b461e785bbed None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.824410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3e3fb-ef9b-4063-a29e-b461e785bbed None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.824890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3e3fb-ef9b-4063-a29e-b461e785bbed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.852668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:40.854581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.855083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.855861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.857636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:40.858238 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.860943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d324d4-7960-4e6e-8428-2268caea13c9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.881256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 317/628] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:40.882913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:40.883431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:40.883903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:40.900994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3e3fb-ef9b-4063-a29e-b461e785bbed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:40.902497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3e3fb-ef9b-4063-a29e-b461e785bbed None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:40.902714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:40.904144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:40.979402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 318/629] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:40.980177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.008202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 312/630] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:04:41.009991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e78017-b93b-4b93-b278-0d4b2da3b8dc None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.010517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e78017-b93b-4b93-b278-0d4b2da3b8dc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.010982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e78017-b93b-4b93-b278-0d4b2da3b8dc None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.012954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 313/631] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:41.014019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e78017-b93b-4b93-b278-0d4b2da3b8dc None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.032436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.082803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.111062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e362e0-ec87-481c-b31d-b4143daac899 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.131400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e78017-b93b-4b93-b278-0d4b2da3b8dc None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.148140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.149165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.149454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.149734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/8a4c03a473c84329a4d982ef47ea0e52/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.165155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=8a4c03a473c84329a4d982ef47ea0e52, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.166272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b37f-a299-4fb8-a628-d23731d1a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.166873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:41.167092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b37f-a299-4fb8-a628-d23731d1a224 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.167378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b37f-a299-4fb8-a628-d23731d1a224 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.167654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b37f-a299-4fb8-a628-d23731d1a224 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.178448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b37f-a299-4fb8-a628-d23731d1a224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:41.182056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 319/632] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:04:40 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/8a4c03a473c84329a4d982ef47ea0e52/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4412b37f-a299-4fb8-a628-d23731d1a224 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:41.186445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:41.187476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 314/633] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:41.193497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.194319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.194396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.194396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.212364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:41.213637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:41.293618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 315/634] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:41.294443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.306412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.337921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542f2e8-b76f-43db-b710-ffe13ffcbe2b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.364228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.379128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.380297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.380813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.381232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.393250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.394748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-991bd1fc-e6f6-4e43-b018-669d2e7deb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:41.413036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:41.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 320/635] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5a24-717a-4339-b77a-5a65392cf031 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.415854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5a24-717a-4339-b77a-5a65392cf031 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.416258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5a24-717a-4339-b77a-5a65392cf031 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.417422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 321/636] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:41.417958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5a24-717a-4339-b77a-5a65392cf031 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.422862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8743f-78be-4c13-91e1-53cf6b1a16aa None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.459997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.460708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.460986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.461263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.462008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:41.462315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.463696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:41.472011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 316/637] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:41.472692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.534862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5a24-717a-4339-b77a-5a65392cf031 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.544411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.571795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1090d-9f8d-4859-9690-e39c09c4f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.572841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1090d-9f8d-4859-9690-e39c09c4f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.573224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1090d-9f8d-4859-9690-e39c09c4f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.573779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1090d-9f8d-4859-9690-e39c09c4f2b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.584672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1090d-9f8d-4859-9690-e39c09c4f2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:41.586457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb14c9-09ad-40c0-ba73-4b4534cbd245 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-e6e1090d-9f8d-4859-9690-e39c09c4f2b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:41.592452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:41.593609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:41.594561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 322/638] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:41.595333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.595452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.595737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.612777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:41.614117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:41.629165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.630273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.630821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.631111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.632099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:41.632421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.634308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:41.645935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.651380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 317/639] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:41.651380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.694960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 323/640] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:41.696328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.752735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996c719-ad53-46ae-b2a6-6a6c565d0a04 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.786846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.797010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.797769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.798055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.798332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.809481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.811086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:41.814436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7675d-86d2-4d13-88e2-72ed92681e1a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:41.829470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:41.830390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:41.831272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:41.831272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:41.831272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:41.831272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:41.831272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 318/641] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:41.832069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.850881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.851562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.851841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.852114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.852903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:41.853200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.854619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:41.864187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 324/642] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:41.864827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:41.895971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:41.943094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24f3f-42a1-4880-893f-dfa367935872 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.974510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2049-d81b-4252-85c4-109dd3b6407b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:41.979270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:41.980165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:41.980514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:41.980916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:41.989093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:41.990648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:42.004684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:42.005811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:42.006899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:42.012414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 319/643] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:42.012414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.015721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.016506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.017566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.017566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.028050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:42.035718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:42.036883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 325/644] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:42.037762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.059888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.118169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1853b-2de1-4ca7-96d3-f5d819734245 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.132870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.146503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba31f-3b1b-47db-9a11-8d62460bcbea None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.151636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.152307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.152591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.152920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.153644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:42.153953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.155337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.171330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 320/645] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:42.171330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.186289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.187095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.187369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.187639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.198367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.199971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:42.217102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:42.218206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:42.219209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:42.219209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:42.219209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:42.219209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:42.223077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 326/646] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:42.223675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.272543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.277097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f478eb2-a5f6-43e7-9299-47223cf6f1b4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.314244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.314851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.315136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.315420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.316212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:42.316527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.318012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.330066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 321/647] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:42.330960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.336725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329796-e115-4c2f-a811-7936a89adbf7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.371547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.372374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.372788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.373166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.374006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:42.374314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.375692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.383925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 327/648] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:42.384745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.387292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.440313 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251d88-7cb1-4655-bdc0-6f6655ab0a46 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.474353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.475166 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.475448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.475718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.483901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.485397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.494769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b7c97-b2c4-403f-97d3-a77ac588ddcd None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:42.499207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:42.500302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 17:04:42.501462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:42.505136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 322/649] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:42.505990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.526251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.537128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.537910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.538259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.538604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.539409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:42.539797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.541287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.556967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 328/650] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:42.557741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.624361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.625420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b62c9b-3957-4dee-a38c-e267b582cdf9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.662194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.662861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.663151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.663425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.664276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=12c6f9c481ec4108a86db440cc90311f) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:42.664592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.666104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.666482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d676f9-c04c-4729-9698-298d59a65e68 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.679779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 323/651] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/role_assignments?user.id=12c6f9c481ec4108a86db440cc90311f&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:42.679779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.719374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.720206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.720492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.720832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.735677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.738024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:42.765500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:42.766556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:42.767452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:42.767452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:42.767452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:42.767452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:42.769887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 329/652] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:42.769887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.780570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.810255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d793e-dc9f-493c-bc35-d51484111485 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.847664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.848680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.849115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.849545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.850584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:42.851069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.852765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.873340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 324/653] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:42.874527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.904107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e1417-0171-4030-bd43-36bcdacdd299 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.924884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.957060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.958180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.959616 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.960708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.970674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.972010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:42.989831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:42.991034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:42.992175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 330/654] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:42.993018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.018485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358fbf-d004-4b3a-8282-4072895b57eb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.067331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.068333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.069059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.069384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.070377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:43.070689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.072332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.084156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.091252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 325/655] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:43.092389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.108428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564582-9c37-4d43-ad1c-b87d1f345417 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.148061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.148936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.149206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.149482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.206010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a11c0-ac7c-4dda-a58d-45f196b477d5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.206496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.248800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.249682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.250061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.250429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.251401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:43.251814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.253468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.259972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.261626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.283383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 326/656] 10.222.0.46 () {56 vars in 1139 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:43.284501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.348270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.385809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 331/657] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:43.387231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.393401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3f9b-cf11-4373-8a7a-9cf5ad2dd649 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.431127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.432216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.432715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.433143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.440772 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.442928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:43.461494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:43.462532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:04:43.463472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:43.467392 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.467627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 327/658] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:43.468575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.506339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807f87-bca3-4f4d-a2f3-49533be426d0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.546665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.547331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.547618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.547946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.584956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbc197-d0ed-4a0e-a31d-20ced999ad60 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.607464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.626315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.627245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.627580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.627859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.633774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.635353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.642932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.644515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-866ec829-98cb-46cb-8243-d77c0d3bf8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:43.664130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:43.665083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:43.665950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:43.665950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:43.665950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:43.665950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:43.665950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 328/659] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:43.666838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fec5a-6ddb-4989-8046-afb7c0c8fa00 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.667143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fec5a-6ddb-4989-8046-afb7c0c8fa00 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.667421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fec5a-6ddb-4989-8046-afb7c0c8fa00 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.673015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 329/660] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:43.673015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fec5a-6ddb-4989-8046-afb7c0c8fa00 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.718870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.746789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 332/661] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:43.751796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.782223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fec5a-6ddb-4989-8046-afb7c0c8fa00 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.823264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.823976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.824237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.824515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.825437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:43.825838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.827198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b082-1184-4ae1-a19e-52a6ddf738c5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.844385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 330/662] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:43.850165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.850465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.850755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.859486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5261-a5f1-4c25-b042-4afe8a1c9715 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:43.867619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:43.868934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:43.894454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:43.896146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:43.897120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:43.897450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:43.897723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:43.898533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:43.898832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:43.900283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:43.916702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 333/663] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:43.916702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.953392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 331/664] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:43.954265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:43.956026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.033448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c76518-7818-4bfd-906c-c90255bf283b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.068463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.069171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455100c6-4045-41c4-b06c-43c5c2275111 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.069283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.069628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.069902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.081648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.083140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:44.101593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:44.102534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:44.103426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:44.103426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:44.103426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:44.103426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:44.103426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 334/665] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:44.104135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.112921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.113706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.113987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.114260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.145100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.192928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.194766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.205194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.229057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1194b8f-847c-427c-aac5-f573316e08ba None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.269844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.270646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.270933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.271211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.280145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.280649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:44.300940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:44.302050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:44.302965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 335/666] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:44.303444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.313544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 332/667] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:44.314277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.377792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.417980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc24fe-36c5-4e2a-9dbb-9d6db01b5046 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.426863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1913b2-cf18-4993-a52c-e3d926930225 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.455530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.456492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.457080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.457473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.461528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.462215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.462659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.462919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.463711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:44.464021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.465590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.468265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:44.477620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:44.478574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:44.479431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 336/668] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:44.480140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.483961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 333/669] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:44.485341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.494534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.604365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3d57-7928-48c1-8e9c-71f7e14d09ee None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.607020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3997-0baa-4eab-a8ad-1949cd179042 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.625307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.644108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.644805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.645111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.645398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.646190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:44.646339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.646523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.647295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.647667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.647985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.648095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.659767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.661277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.668015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 337/670] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:44.668015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:44.680135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:44.681237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:44.682315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:44.682315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:44.682315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:44.682315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:44.685919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 334/671] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:44.686837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.749234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:44.790204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352b27e-b9f9-4fa5-ba1c-836cb1654ac0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.824275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b31cd-1788-4c35-af25-7065ed8b5616 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:44.833094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.834124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.834617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.835106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.843969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.845499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:44.863360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:44.864568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:44.865733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:44.867346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:44.868147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:44.868495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:44.868868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:44.869724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:44.870128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:44.870855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 338/672] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:44.871871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:44.872111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.887236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 335/673] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:44.887236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:44.930559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.001559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d0bbc-1a31-44bf-b746-8574e69dfa7c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.001795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865fe29-e5a1-4669-9d03-1acec493e50b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.033073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.042350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.043013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.043181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.043292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.043646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.043859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.044162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.044447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.044550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=49486e8648f34ebf82979c60ab45ff6b) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:45.044808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.045204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:45.045525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.046263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.046922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.060687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 339/674] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/role_assignments?user.id=49486e8648f34ebf82979c60ab45ff6b&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:45.060687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.071494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 336/675] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:45.072501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.178298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.188289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015444d3-467f-4f43-bb8c-bd87347c1fc4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.191533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19961-b5ac-48cf-85a6-3d5be27844aa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.224763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.225448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.225734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.226015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.226813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:45.227131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.228752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79557-6e27-464a-94c3-4626547a9d9d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.232800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.233633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.233922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.234202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.243474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 340/676] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:45.244729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0612ab-35bd-4d4d-8b88-ff9a64500980 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.245022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0612ab-35bd-4d4d-8b88-ff9a64500980 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.245297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0612ab-35bd-4d4d-8b88-ff9a64500980 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.246776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 341/677] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:45.250725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0612ab-35bd-4d4d-8b88-ff9a64500980 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.250918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.252409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:45.274227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:45.275402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:45.276466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:45.276466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:45.276466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:45.276466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:45.276466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 337/678] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:45.276818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.388181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da1b0b-73e9-4b1b-a8a1-439641ef0cc3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.426969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.427786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.428140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.428579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.429473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=9584ad1287d346f89ef31dd00dc1609c) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:45.429850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.431405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f57dd2-2693-43b4-9cf5-f1ae95fda4d0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.438571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 338/679] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/role_assignments?user.id=9584ad1287d346f89ef31dd00dc1609c&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:45.439796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.440179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.440552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.467395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.467632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:45.469739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:45.471675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.532742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0612ab-35bd-4d4d-8b88-ff9a64500980 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.562214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 339/680] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:45.563902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.574974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.576148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.576723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.577229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.585302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.587314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:45.605220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:45.606471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:45.607618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:45.608373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 342/681] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:45.613996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.694199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5bc00-705d-4eef-a80b-e0abcab33354 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.736867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.737122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944972-e78e-4c7a-93cf-05f5b1033bcb None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.737957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.738341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.738809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.739761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:45.740173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.741713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.748829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.756461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 340/682] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:45.760766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.770538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:45.790108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.791564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.792502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.793737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.812656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:45.823995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:45.825110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:45.825998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:45.827374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 343/683] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:45.827374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.878692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce76fc-6384-4cfe-9acd-8b545fd1249b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.931246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.933063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.933929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.934431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.936132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:45.936948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.939300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:45.944671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814961e3-cd22-435d-a7c4-020ca5ee5557 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:45.958488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 341/684] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:45.960512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:45.983045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:45.983863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:45.984146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:45.984437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:45.992379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:45.993910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:46.008409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:46.009601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:46.010539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:46.014568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 344/685] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:46.015826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:46.043381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:46.049235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:46.102447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088d2a-38da-47fb-a65d-7e86230e288e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.120405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36613-c1bd-4f99-a3ed-c4992ad46a6b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.147908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.149682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.150180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.150780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.152297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:46.152886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.154527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.155850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.156526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.156847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.157125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.158059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=d7460f33e2f74a1e86b76eab550b7c79) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:46.158304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.159782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.166292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 345/687] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/role_assignments?user.id=d7460f33e2f74a1e86b76eab550b7c79&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:46.166598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 342/687] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:46.167160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:46.176743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:46.380527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:46.382894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a672f11-9249-4417-99b7-f4e527ae70d2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.391086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a6b6a-4248-4029-ac91-b57af8855946 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.419867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:46.440663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.441358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.441637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.441909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.442329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.442755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:46.443063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.443773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.444251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.444521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.444971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.459899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.462706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.464396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 346/688] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:46.470188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:46.485153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:46.486564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:46.487718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:46.487718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:46.487718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:46.487718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:46.490065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 343/689] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:46.494921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:46.611817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0391e6-35de-4d43-a3de-63ddec1d4db0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.612392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e3368-a98f-459a-b818-5bf7841b1b57 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.651702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.653060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.653670 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.654097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.654423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.654875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.655160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.655432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.656083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:46.656636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.658265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.672084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 344/690] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:46.678598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:46.688711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:46.760344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:46.784429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.785984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.873587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240dd7-fc6b-4ec0-b997-b093ad80dbaa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:46.939922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154843-2911-4716-865d-c97631628de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:46.940770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154843-2911-4716-865d-c97631628de4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:46.941057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154843-2911-4716-865d-c97631628de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:46.941331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154843-2911-4716-865d-c97631628de4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:46.954847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154843-2911-4716-865d-c97631628de4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:46.956325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154843-2911-4716-865d-c97631628de4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-83154843-2911-4716-865d-c97631628de4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:46.973738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:46.974728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:46.976341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 345/691] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:46.980658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154843-2911-4716-865d-c97631628de4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.048991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 347/692] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:47.056060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.078215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:47.086403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154843-2911-4716-865d-c97631628de4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:47.169018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:47.247224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:47.247879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.248170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.248451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.249331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:47.249647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:47.251096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:47.267781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4b285-df6d-4163-8f5b-ad986e54966f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:47.269428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 346/693] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:04:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:47.274954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.344870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:47.346126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.346615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.347144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.377731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:47.379593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:47.383655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b9811-e4f1-4f1f-8ded-2f28a85671a2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:47.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:47.418278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:47.419212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:47.419212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:47.419212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:47.419212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:47.421765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 348/694] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:47.428510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.437070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447a08-0fd6-4bd6-bdfc-85a7fd4f485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:47.437767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447a08-0fd6-4bd6-bdfc-85a7fd4f485c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.438054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447a08-0fd6-4bd6-bdfc-85a7fd4f485c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.438330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447a08-0fd6-4bd6-bdfc-85a7fd4f485c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.498401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:47.586889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7378d-2945-40ec-b440-2c272f15186f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:47.601067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:47.608844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447a08-0fd6-4bd6-bdfc-85a7fd4f485c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:47.611009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447a08-0fd6-4bd6-bdfc-85a7fd4f485c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:47.662867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:47.662867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.663201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.663466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.664061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:47.664558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:47.665938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed8276-663b-47f3-8f68-2fd963b08a51 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:47.680476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 349/695] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:47.681983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710689-16fd-49b3-8acf-d5d5e442f45b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.682276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710689-16fd-49b3-8acf-d5d5e442f45b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.682556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710689-16fd-49b3-8acf-d5d5e442f45b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.684185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 350/696] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:47.689532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710689-16fd-49b3-8acf-d5d5e442f45b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.733848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 347/697] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:04:47.735469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.735862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.736242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.754006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:47.755289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:47.813141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:47.837974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710689-16fd-49b3-8acf-d5d5e442f45b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:47.841751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 348/698] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:47.842997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.901046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:47.901982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:47.902272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:47.902559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:47.912378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:47.914536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:47.935147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:47.936104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:47.937019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:47.940699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 351/699] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:47.941756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:47.967618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b299b-e6e8-489e-a97a-cf9ed29b26cf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:47.977441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.006032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.006954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.007504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.007884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.019873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.021621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:48.041393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:48.042565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:48.043726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:48.043726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:48.043726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:48.043726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:48.049123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 349/700] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:48.050194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.075023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d7374-bd7c-424b-bd78-616437b77682 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.091807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.111612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.112422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.112741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.113016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.123647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.125181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:48.143687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:48.144687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:48.145681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:48.145681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:48.145681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:48.145681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:48.145681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 352/701] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:48.145681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.169800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93d247-0439-4f4d-bdd8-2eda386c2f93 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.205016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.205948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.206412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.206842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.207651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:48.208134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.210816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cb2aa-2407-43aa-a23e-b95c071097b2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.231358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 350/702] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:48.231358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4620a-0cdb-470d-aed6-9db785642e6d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.231358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4620a-0cdb-470d-aed6-9db785642e6d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.231358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4620a-0cdb-470d-aed6-9db785642e6d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.231358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 351/703] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:48.231358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4620a-0cdb-470d-aed6-9db785642e6d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.237177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.266127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ae0fe-d4cd-4fa7-a660-25afc1ce9e89 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.303687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.304592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.304920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.305195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.305932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:48.306242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.307648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.320045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 353/704] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:48.320941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.344323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.357511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4620a-0cdb-470d-aed6-9db785642e6d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.399683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.400754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.401219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.401784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.402849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:48.403356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.405721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9de6-7c31-4bcf-aae9-8b23f646adbe None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.428800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 352/705] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:48.428800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.428800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.428800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.443503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:48.444693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:48.455517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14c82-b437-41e7-9355-81816bc0a56f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.497904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.499088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.500049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.500346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.501238 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=8a4c03a473c84329a4d982ef47ea0e52) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:48.501555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.503025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.506982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.521510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 354/706] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/role_assignments?user.id=8a4c03a473c84329a4d982ef47ea0e52&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:48.522692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.537283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 353/707] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:48.538287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.649002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227feee-38a4-4c4f-9f47-58b6ea789de1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.649349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.673475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a9500-3fbd-493b-8d56-8e0105dc18d5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.687286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.687888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.688171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.688443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.696557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.698079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:48.713727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:48.714915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:48.716023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:48.718104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.718981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.719428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.719969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 355/708] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:48.720175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.720910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.721208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.722967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.756981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 354/709] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:04:48 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:48.758692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.818684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:48.876035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5810f-dc5f-4a1c-b547-99ae3a754969 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.922283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.923467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.923846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.924215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] PATH_INFO: `/v3/services/network` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.925061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:48.926839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:48.931277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371749e-7137-4c82-a85a-a4e9d6e67fde None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:48.944572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:48.946090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:04:48.947121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:48.949288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 356/710] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:48.957580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:48.992564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:48.993639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:48.994984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:48.995415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:48.996440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:48.996925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:49.001507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:49.009722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:49.018627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 355/711] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:49.028786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:49.107948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aebed0-cb99-4adf-9383-dc89463b9e2f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:49.142548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:49.154913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:49.155610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.156082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.156366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.157420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] RBAC: Adding query filter params (name=network) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:49.157732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:49.159403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda86a9-4e9e-4ea1-a244-da4623d67354 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:49.160188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d706f-e9e1-49fc-85db-748af374f965 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:49.169758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 357/712] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:04:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:49.169758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386d3f7-b179-4d64-8550-fc6156364a3a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.169758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386d3f7-b179-4d64-8550-fc6156364a3a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.169758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386d3f7-b179-4d64-8550-fc6156364a3a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.172963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 358/713] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:49.174069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.174899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.175189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.196094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:49.197484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:49.211789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:49.213113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.214032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.214640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.215898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=444a244a713944db9caf259034ccd231, user.id=12c6f9c481ec4108a86db440cc90311f) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:49.216703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:49.218802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:49.227818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 356/714] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:49 2022] GET /identity/v3/role_assignments?user.id=12c6f9c481ec4108a86db440cc90311f&scope.project.id=444a244a713944db9caf259034ccd231&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:49.229098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:49.276646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 359/715] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:49.308916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:49.322696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:49.389078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b82b-16e4-4b06-a165-61dcde72dd60 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:49.431983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:49.432736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.433075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.433365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.434153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:49.434472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:49.435974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:49.447768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 357/716] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:04:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:49.538753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfb89-8f74-47dc-ad55-85cba2e108cd None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:49.562501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:49.582454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:49.583666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.584155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.584691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.585645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:49.587330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:49.601054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:49.602136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:04:49.602978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:49.606137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 360/717] 10.222.0.46 () {56 vars in 1129 bytes} [Mon May 23 17:04:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:49.612690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:49.739829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c462a-af08-4aab-867f-3760a1b189c0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:49.783113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:49.798553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:49.804625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:49.804625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:49.804625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:49.804625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:49.804625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:49.804625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb8027-6990-4aae-b931-48798313e8b7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:49.809712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 358/718] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 17:04:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:49.816315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:49.981893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377e064-471f-4e8b-9bb8-e3d38f0cb7d9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:50.029295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:50.029916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:50.030433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:50.030946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:50.031816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:50.032129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:50.033679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40db8-de0d-45d7-b357-cf0a21e3f05c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:50.042212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 361/719] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 17:04:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:51.552540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea59c0-8aad-4c9a-b73c-cb44a0c841a7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:51.553198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea59c0-8aad-4c9a-b73c-cb44a0c841a7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:51.553505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea59c0-8aad-4c9a-b73c-cb44a0c841a7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:51.555949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 359/720] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:51.561758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba1c1-ee7b-433d-a6f8-bb1585e803b4 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:51.562287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba1c1-ee7b-433d-a6f8-bb1585e803b4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:51.562593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba1c1-ee7b-433d-a6f8-bb1585e803b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:51.591845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-343ba1c1-ee7b-433d-a6f8-bb1585e803b4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:51.593093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-343ba1c1-ee7b-433d-a6f8-bb1585e803b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:51.660853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:51.703488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 362/721] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:51.740704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea59c0-8aad-4c9a-b73c-cb44a0c841a7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:51.884142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9103e-4aba-4fbe-850b-bccccd1751fa None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:51.884801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9103e-4aba-4fbe-850b-bccccd1751fa None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:51.885323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9103e-4aba-4fbe-850b-bccccd1751fa None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:51.887846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 363/722] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:51.894190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:51.894477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:51.894757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:51.916223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea59c0-8aad-4c9a-b73c-cb44a0c841a7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:51.923962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:51.928868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:51.981434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:51.984316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:51.984918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:51.985428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.010371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:52.028489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:52.029693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:52.030576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:52.040840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 360/723] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:52.046354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.065600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 364/724] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:52.113629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:52.117596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.197802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093621a5-0c1b-4026-81fe-c6e52a70c08e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.236388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.237506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.238011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.238483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.239480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:52.240001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:52.241638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:52.264041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 361/725] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:52.265770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.333576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de75445-6687-4a29-8c95-8a48f85dbd59 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.351265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:52.380858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75214eb-1be4-48c5-aa59-a30c90975b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.382045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75214eb-1be4-48c5-aa59-a30c90975b90 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.382527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75214eb-1be4-48c5-aa59-a30c90975b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.382997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75214eb-1be4-48c5-aa59-a30c90975b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.394909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75214eb-1be4-48c5-aa59-a30c90975b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-d75214eb-1be4-48c5-aa59-a30c90975b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:52.403021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:52.404111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:52.404974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:52.410799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 365/726] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:52.410799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de522eb-b168-4936-bdc4-c58267ac4fd0 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.410799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de522eb-b168-4936-bdc4-c58267ac4fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.410799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de522eb-b168-4936-bdc4-c58267ac4fd0 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.410799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 366/727] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:52.411425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e5d79-d367-4a78-90fe-648f471d975b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.411654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e5d79-d367-4a78-90fe-648f471d975b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.411935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e5d79-d367-4a78-90fe-648f471d975b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.416730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 367/728] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:52.417658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e5d79-d367-4a78-90fe-648f471d975b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.436446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724bf19-c337-4b14-b7ac-b8380466dc1c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.449998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:52.472994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.473927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.474215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.474493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.486134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:52.487658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-24bd287c-f124-4626-abbe-62a0bfa7eb94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:52.506943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:52.507900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:52.508828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:52.508828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:52.508828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:52.508828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:52.510468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 362/729] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:52.511770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.512089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.512365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.529714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:52.530886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:52.532276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e5d79-d367-4a78-90fe-648f471d975b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.572782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.573474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.573743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.574022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.574927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:52.575235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:52.576661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275831be-6c54-486b-bd5e-3d1cc993dd83 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:52.586630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 368/730] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:52.588021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.588313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.588590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.606298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:52.607577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:52.613679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 363/731] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:52.615438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.629900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:52.685340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 369/732] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:52.686183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.748699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:52.757991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8794a8-5574-4c36-8678-9d49dc2fa76b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.801353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa775aa6-c5b0-48ca-976a-a05ddd21dae0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.803004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.803688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.803973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.804240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.805003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:52.805312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:52.806692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:52.819332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 364/733] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:52.820650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.837553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.838361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.838641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.838913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.850819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:52.852366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:52.869736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:52.870664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:52.871727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:52.871727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:52.871727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:52.871727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:52.875765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 370/734] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:52.876646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:52.889800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:52.935387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25737d8-7b1e-42ce-8e02-7f398d26817c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.969560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:52.970353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:52.970639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:52.970920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:52.971690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:52.973117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:52.980567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412d31-7ad2-4d37-8310-a69edac5ebff None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:52.987974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 365/735] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:04:52 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:52.988831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.007457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.048882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.049834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.050120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.050395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.062949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:53.070922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:53.077619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 371/736] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:53.078651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.125718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c56454-a344-40ed-b3f3-613268d70428 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.156340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.164983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.165826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.166108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.166403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.175286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.176806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2cf9adf7-05ce-4751-8358-3c89637d6a84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:53.192022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:53.193287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:04:53.194222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:53.198521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 366/737] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:04:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:53.199011 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee56a0c-4e98-4d0b-b015-42ede1f2beb4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.199414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb567-043e-4ca9-84f2-68fea9788959 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.199698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb567-043e-4ca9-84f2-68fea9788959 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.199974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb567-043e-4ca9-84f2-68fea9788959 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.201388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 367/738] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:53.201968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb567-043e-4ca9-84f2-68fea9788959 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.250579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.251411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.251763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.252116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.252889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:53.253201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.254608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.267793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 372/739] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:53.268540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.286919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.314328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb567-043e-4ca9-84f2-68fea9788959 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.359210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.360261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.360752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.361189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.362452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:53.362960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.365078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebe41e-a3c9-452c-83bf-e3d0c898e01e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.385944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 368/740] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:53.385944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.385944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.385944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.405897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b90e8-d317-4597-9b64-d27c7aa9a579 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.408536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:53.410158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:53.444232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.457445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.458630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.459104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.459653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.461217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:53.461792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.464321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.492932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 373/741] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:53.494159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.509315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 369/742] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:53 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:04:53.510411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.585662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.607222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1497f-d117-4204-bf5a-762f93b44942 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.621613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f989ad-375e-48d2-a043-77961f6de890 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.645119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.645940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.646285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.646636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.655082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.656665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.659516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.660447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.660845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.661213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.671808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:53.672342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:53.673468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:53.674628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:53.675962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.676959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 374/743] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:53.678223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:53.694539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:53.695673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:53.697169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:53.697169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:53.697169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:53.697169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:53.702334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 370/744] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:53.702334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.737718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.807946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bbdff-97b7-4701-8051-da8741d29cc5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.809368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338056-5449-49ea-b20a-b0e24486de75 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:53.828302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:53.843499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.844079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.844357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.844657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.846751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:53.847430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:53.847722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:53.848008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:53.848771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.850170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.874019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 371/745] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:04:53 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:04:53.875044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:53.919714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:53.921385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:53.974644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.030305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a9541-02e3-4bc9-aec7-81793cad0ecc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.058962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 375/746] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:04:54.059608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.075482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.076471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.077070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.077362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.078240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:54.078564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.080043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.104765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 372/747] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 17:04:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:54.104765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.141687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.180370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c95c1-ea19-4dc8-bd32-6e5ba16c4abc None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.215853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.216348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aa771-2a65-46b0-b11a-c9c01c93e94c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.216816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.217193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.217580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.218448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:54.218791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.220281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.236795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 376/748] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:54.236795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.237523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.259195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.260016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.260303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.260580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.271567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.273171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:54.291688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:54.292915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:54.293918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:54.293918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:54.293918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:54.293918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:54.296728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 373/749] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:54.297591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.342300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3611-4f9e-4321-80e6-39b73783d1e0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.379776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.382065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.382872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.383363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.388975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.403025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddbdb9-476f-43d4-92b9-239af5779976 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.439224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.440046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.440331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.440625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.448201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.449783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.457926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.459537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.462333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:54.466160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:54.467274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:04:54.468411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:54.472205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 374/750] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:54.473243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.567631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 377/751] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:04:54.568831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.581099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c705-ff8f-4001-8321-e50006be5152 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.615698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.616387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.616717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.617006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.617801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:54.618115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.619585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.636275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 375/752] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:54.637285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.648932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.673936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68256e89-e19a-4765-b49f-560a16299ac3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.677061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.710685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.711713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.712168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.712635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.713648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:54.714127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.715830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.735416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 378/753] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:54.736594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.745027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f169fa-ceb7-49c7-b7c4-24ea64c8ec6e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.781609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.782474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.782766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.783041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.800066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.801435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:54.819536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:54.820444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:54.821350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:54.821350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:54.821350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:54.821350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:54.825593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 376/754] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:54.826385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.847675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66d47-b35b-4695-b208-7f5c0d19d4ec None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.883017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.884213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.884724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.885177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.885421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.892936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.894611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:54.908537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:54.909476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:54.910334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:54.912757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 379/755] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:54.913735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:54.933838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362219-9e69-405a-9fa5-460a7ec5932a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:54.939565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:54.970742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:54.971656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:54.971943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:54.972221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:54.983097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:54.984789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:55.003485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:55.004433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:55.005635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:55.005635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:55.005635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:55.005635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:55.009407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 377/756] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:55.010428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.022626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6df27-b58e-4923-bf84-28307c0eed5f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.075748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.077176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.078175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.078793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.080026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.080748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.083141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.100895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 380/757] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.102098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.131368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2d3d-ddad-4b25-910c-c10cc8616c50 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.145107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:55.179645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.180943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.181423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.181870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.182832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.183521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.186077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.200894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:55.207743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 378/758] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.209893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.221540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef9c5-09e1-4fca-bc0f-ba704250c9a1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.258691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.259467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.259760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.260160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.261030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.261342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.262924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.275689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 381/759] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.276525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.322977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6302abe-de4a-4689-946b-0855f8c9862b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.357906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.358720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.359012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.359296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.366098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.367683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f600e65c-e3e1-4993-9656-29f6d9633618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:55.381949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:55.382816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:55.383722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 379/760] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:55.384503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f301-b426-4669-92f0-d2e532bf1114 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.384715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db7af2-926f-46c4-8f44-e74af38015c0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.384812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f301-b426-4669-92f0-d2e532bf1114 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.385060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f301-b426-4669-92f0-d2e532bf1114 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.390912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 380/761] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:55.391692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f301-b426-4669-92f0-d2e532bf1114 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:55.426202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.426881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.427202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.427446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.428290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=2f60f49044d04b0fb795873494fc8d34) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.428663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.430225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.436074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 382/762] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/role_assignments?user.id=2f60f49044d04b0fb795873494fc8d34&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.446015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.460223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:55.510294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1f301-b426-4669-92f0-d2e532bf1114 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.551314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.552592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.552592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.552888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.561182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.562748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-28c6fd5d-bf54-4402-bae8-ed8e88303f4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:04:55.578445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:55.579423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:04:55.580325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:55.585054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 381/763] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:55.586735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.587414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.587414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.594765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e71c-af15-4fb4-b069-2da56c4d9287 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.606942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:55.608373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:55.642970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.644762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.645329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.645601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.646408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.646963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.649177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.665458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 383/764] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.666349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.695959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 382/765] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:04:55.696811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.730239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:55.760886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:55.803863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a909f-8aa6-4d5a-b929-cc00da76f0f0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.836156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769ce6-ade9-4f6c-a89b-e81284643b8f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:55.845963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.846782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.847170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.847574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.848558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.849005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.850655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.864713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 384/766] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.865569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:55.880876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:55.881745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:55.882139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:55.882588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:55.883746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=444a244a713944db9caf259034ccd231, user.id=8a4c03a473c84329a4d982ef47ea0e52) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:55.884174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:55.885849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:55.900811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 383/767] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/role_assignments?user.id=8a4c03a473c84329a4d982ef47ea0e52&scope.project.id=444a244a713944db9caf259034ccd231&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:55.902085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.007546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c297f90-593c-48c5-8b32-44c3ecea2d23 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.052097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:56.056265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.057231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.057527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.057860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.059024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.060483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:56.074512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:56.075799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:56.076831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 385/768] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:04:55 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:56.082358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.132203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:56.163215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9c46-6325-4e83-bd9e-cef0d1bc47f7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.228576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbae2-d5df-4753-bf96-4dfe371fd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.230257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbae2-d5df-4753-bf96-4dfe371fd516 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.230595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbae2-d5df-4753-bf96-4dfe371fd516 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.230878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbae2-d5df-4753-bf96-4dfe371fd516 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/12c6f9c481ec4108a86db440cc90311f/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.233843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bbae2-d5df-4753-bf96-4dfe371fd516 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=12c6f9c481ec4108a86db440cc90311f, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.234994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b781c-8e50-471e-8c78-144106369ab9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.235322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bbae2-d5df-4753-bf96-4dfe371fd516 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.253843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 384/769] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:04:55 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/12c6f9c481ec4108a86db440cc90311f/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:56.255707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e935-9ca9-4cfd-be16-ab2ef5419754 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.256002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e935-9ca9-4cfd-be16-ab2ef5419754 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.256292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017e935-9ca9-4cfd-be16-ab2ef5419754 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.263047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 385/770] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:56.264651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.265629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.265912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.278511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.279333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.279687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.280148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.281065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] RBAC: Adding query filter params (name=network) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:56.281450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.283006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.287404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:56.288672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:56.289015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 386/771] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:56.295300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.366416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:56.423540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 386/772] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:04:56.424582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcad526-83e1-43f0-96f1-b1cb51cca004 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.453598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.461941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.463009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.463486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.463948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.465613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] RBAC: Adding query filter params (type=network) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:56.466216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.467846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.474160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 387/773] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:56.479761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.603300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:56.608354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e2699-60e7-4988-a2a0-2d56fad72d22 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.635587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:56.648293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bf52d-9c78-437c-bc62-36798f85ccf6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.663368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.664556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.665245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.665722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.666991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] RBAC: Adding query filter params (interface=public, service_id=5babc37e22414ff1b9e0969a774bef0e, region_id=RegionOne) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:56.667485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.669643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.680430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 388/774] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/endpoints?service_id=5babc37e22414ff1b9e0969a774bef0e&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:56.683304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.684243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.684854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.685136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.685795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.686181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.687174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:56.704055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:56.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:56.706353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 387/775] 10.222.0.46 () {56 vars in 1129 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:56.711388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:56.815389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e809f-b1cd-4555-abb2-bd47756e6f01 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.851828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.852988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.853529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.854002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.854911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.856615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.858883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e673f-c59c-4fce-807e-e7123c8b28ea None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:56.863022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 389/776] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:56.919043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:56.919762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:56.920047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:56.920327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:56.921093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:56.921401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:56.922824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:56.929729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:56.933564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 388/777] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:56.940152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:57.017901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:57.082389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e57a-319a-4e18-b5a9-a9987d7de91b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:57.117443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:57.118474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:57.118956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:57.119428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:57.120334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:57.120860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:57.122591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:57.128351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 390/778] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 17:04:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:57.133739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:57.277776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513789a0-59a7-456d-bbbb-fb38b6dea484 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:57.316039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:57.316759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:57.317046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:57.317321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:57.318133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] RBAC: Adding query filter params (interface=public, service_id=07de1fc9ef494daa8fc16b87326ba80c, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:57.318446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:57.319869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9e3f-d0d7-40ec-8683-d9dbc6126a58 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:57.331618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 389/779] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:04:57 2022] GET /identity/v3/endpoints?service_id=07de1fc9ef494daa8fc16b87326ba80c&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:57.337127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:57.478764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640b09f-2361-44e5-8553-9b9a5ffe0059 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:57.490235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:57.521169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a08f6-1c76-4319-a73f-0831d30f15f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:57.521905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a08f6-1c76-4319-a73f-0831d30f15f8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:57.522206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a08f6-1c76-4319-a73f-0831d30f15f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:57.522486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a08f6-1c76-4319-a73f-0831d30f15f8 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:57.523186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a08f6-1c76-4319-a73f-0831d30f15f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:57.524583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a08f6-1c76-4319-a73f-0831d30f15f8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:57.533348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 391/780] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:04:57 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:58.023310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2dff2-3d0c-4ee2-b823-b98267f273b9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.023970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2dff2-3d0c-4ee2-b823-b98267f273b9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.023970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2dff2-3d0c-4ee2-b823-b98267f273b9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.025589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 390/781] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:58.031043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9315aa-2612-49db-847d-6189661e56db None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.031441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9315aa-2612-49db-847d-6189661e56db None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.031623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9315aa-2612-49db-847d-6189661e56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.055246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1a9315aa-2612-49db-847d-6189661e56db None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:58.056382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1a9315aa-2612-49db-847d-6189661e56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:58.148707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 392/782] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:04:58.164489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2dff2-3d0c-4ee2-b823-b98267f273b9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:58.236503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:58.276910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2dff2-3d0c-4ee2-b823-b98267f273b9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:58.314446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239c3c8-78d8-4c6a-9f87-d61113bb2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:58.315177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239c3c8-78d8-4c6a-9f87-d61113bb2ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.315459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239c3c8-78d8-4c6a-9f87-d61113bb2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.315731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239c3c8-78d8-4c6a-9f87-d61113bb2ce3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.326367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239c3c8-78d8-4c6a-9f87-d61113bb2ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4239c3c8-78d8-4c6a-9f87-d61113bb2ce3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:58.334170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:58.335098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:04:58.335929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:58.340384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 391/783] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:58.341870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9315aa-2612-49db-847d-6189661e56db None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:58.454533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9315aa-2612-49db-847d-6189661e56db None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:58.456952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:58.502732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:58.503435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.503715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.503985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.504778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:58.505086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:58.506485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:58.513003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f92cd-d13e-46da-9ec9-8e80d240c58a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.513280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f92cd-d13e-46da-9ec9-8e80d240c58a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.513558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f92cd-d13e-46da-9ec9-8e80d240c58a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.515487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 392/784] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:04:58.523133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.523133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.523133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.528709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 393/785] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:58.531552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:58.549475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:58.550922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:58.658516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 393/786] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:04:58.684061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123c75-89f6-446b-98eb-7e5dff82bbf3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:58.697266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:58.756733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:58.758935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4970af-741f-476f-894a-48193d48933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:58.759759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4970af-741f-476f-894a-48193d48933f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.760041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4970af-741f-476f-894a-48193d48933f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.760312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4970af-741f-476f-894a-48193d48933f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.789287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4970af-741f-476f-894a-48193d48933f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:58.790795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4970af-741f-476f-894a-48193d48933f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-0e4970af-741f-476f-894a-48193d48933f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:58.830795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:58.831926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:58.833020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:58.833020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:58.833020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:58.833020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:58.837667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 394/787] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:58.838991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4970af-741f-476f-894a-48193d48933f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:58.857775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad580-f4ef-4551-a568-4d21a00cb46c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:58.885947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:58.901153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:58.902247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:58.902554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:58.902830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:58.914238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:58.926569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:58.927497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:58.928338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 394/788] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:58.933608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.040262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c88d4-1938-4de8-8ec2-a2aec2363289 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.081088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.090492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4970af-741f-476f-894a-48193d48933f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.116766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.117585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.117881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.118165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.118940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:59.119254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.120698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.139944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 395/789] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:04:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:59.144672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.170018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.170637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.170937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.171223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.171967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:59.172284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.173741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.206288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 395/790] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:04:59.209718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.291407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfd7db-4045-48b7-9a91-6034bb34afad None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.337877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.340016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.340872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.341320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.341601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.357081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.359281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.361993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd681484-27c8-40d9-80ac-67f320fb0d80 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e0439f0c-581c-4034-bf6f-9a163a4abccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:59.381011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:59.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:59.383190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:59.383190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:59.383190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:59.383190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:59.383190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 396/791] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:59.383974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b152c-74ee-4e6b-96ff-f049870b80f0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.386587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b152c-74ee-4e6b-96ff-f049870b80f0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.386587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b152c-74ee-4e6b-96ff-f049870b80f0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.388681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 397/792] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:59.389467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b152c-74ee-4e6b-96ff-f049870b80f0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.403290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.404135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.404417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.404740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.412783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.414459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.426197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-a901e490-cbbb-4435-82a5-8b7a5fa2b870 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:59.431401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:59.433705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 396/793] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.435942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.437893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.457303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:04:59.459105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:59.510692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b152c-74ee-4e6b-96ff-f049870b80f0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.551711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.552731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.553089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.553395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.554219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:59.554539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.556019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.560682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 397/794] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:04:59.561608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.581910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 398/795] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:59.588792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.651937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.693933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.696674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f813-8b3f-43cb-9d2c-109e10cbf6b3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.707909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674fcd7-a9c0-4286-ae5b-ffe82ccf43e8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.738677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.739362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.739648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.740086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.740781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:04:59.741086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.742533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.745889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.746903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.747193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.747474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.756094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.758396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.764736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 398/796] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:04:59.764736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-10c8acf7-7456-4fd2-b5e9-cf73f2f63611 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:04:59.781086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:59.782082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:59.783013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 399/797] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:04:59.783615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26cf0-b133-4327-9212-5048983705e5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.784663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26cf0-b133-4327-9212-5048983705e5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.784663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26cf0-b133-4327-9212-5048983705e5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.785579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 400/798] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:04:59.790216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26cf0-b133-4327-9212-5048983705e5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.870727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54f7be-3f2b-4a97-9650-59a7dc05bed5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.903926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.910162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26cf0-b133-4327-9212-5048983705e5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:59.913362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.914175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.914470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.914746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.925039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:04:59.932725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:59.934035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 399/799] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:59.935258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:59.953477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:59.954220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.954513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.954787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:59.965670 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:59.967225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:59.976537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-28fb31f3-af9c-4ade-be9c-7fe66d375b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:04:59.986403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:04:59.987546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:04:59.988663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:04:59.988663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:04:59.988663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:04:59.988663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:04:59.995689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 401/800] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:04:59.995689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:59.995689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:59.995689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.012319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:00.013591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:00.045717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d70b05-841f-4bce-be28-2b9a811574e3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.079856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.080582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.080906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.081182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.082051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.082361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.083881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.085891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 402/801] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:04:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:00.087447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.117173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 400/802] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 17:04:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.118870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.165738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.203768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce04077-17c1-416e-a530-c3538d98b4a0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.222421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af629622-8f8b-429e-916b-0a2ef6663254 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.231716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.238748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.239434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.239722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.239996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.240767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.241083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.242649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.257908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 403/803] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.257908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.267615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.268377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.268760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.269039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.269787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.270097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.271511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.283230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 401/804] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.284104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.359583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f2f4-0416-4a42-9ce9-6e63d5974b1f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.384523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940f153-2753-4264-83b5-aed11bbe50f5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.386911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.391641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.392452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.392780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.393041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] PATH_INFO: `/v3/services/network` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.393694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.395081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:00.406745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:00.407749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:00.408582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 404/805] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:00.409631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.424808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.425621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.425907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.426195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.436974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.438437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-13630858-e644-4500-a3af-bf2e6bf6b22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:00.455055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:00.456058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:00.456985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:00.456985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:00.456985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:00.456985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:00.456985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 402/806] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:00.457722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ace8e-3dac-4848-8332-bcc0e35ae270 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.458007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ace8e-3dac-4848-8332-bcc0e35ae270 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.458283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ace8e-3dac-4848-8332-bcc0e35ae270 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.459523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 403/807] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:00.460207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ace8e-3dac-4848-8332-bcc0e35ae270 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.467631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.512682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe3845-514c-4390-9f75-9238d1108a20 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.548118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.549894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.550416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.550883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.561900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.563404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.566575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ace8e-3dac-4848-8332-bcc0e35ae270 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:00.580536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:00.581660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:00.583002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:00.583002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:00.583002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:00.583002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:00.583002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 405/808] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:00.583002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.602506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.603322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.603600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.603845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.610778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.612239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:00.627985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:00.629157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 404/809] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:00.635033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.651109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.681072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422905a-b9c8-46b3-b0fa-737d9344520c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.689765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.713873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.714480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.714822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.715109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.715813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.716123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.717541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f031-2aef-488a-a026-c4125a99c8e7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.721912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 406/810] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.723061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.723350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.723634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.732815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c45e-73f8-4e90-848d-936e81cb7a22 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.739289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:00.740490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:00.766864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.767532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.767818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.768094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.768855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.769164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.770564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.781737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 405/811] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.782549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.815975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 407/812] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:00.816857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.865010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.889585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9812f-834b-4261-8348-e1e4876d1676 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.919457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9737480-9e4b-4503-9ef5-96a30bda3be6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:00.920985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:00.922957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.923736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.924024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.924298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.925043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.925348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.926743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.939116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 406/813] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.940411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:00.955060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:00.955728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:00.956010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:00.956285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:00.957111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:00.957419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:00.958869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:00.970491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 408/814] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:00.971215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.046348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d4dc-f428-48fe-9f5c-8c3da2f17f5c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.068574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aa65f-0133-45e9-96c9-78f43fcc1a3c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.081917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.082661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.082969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.083228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.083940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] RBAC: Adding query filter params (type=network) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:01.084243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.085662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.087709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.091401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 407/815] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:01.092192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.107847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.108771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.109055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.109330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.116106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.117595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:01.131408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:01.132278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:01.133200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 409/816] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:01.134117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.162225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.194912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc3eac-b8e9-4ee5-8b5d-019b0841c8fa None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.227892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.228682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.228970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.229245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.229905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.231362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.239712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1cabb-08c5-4e22-bf4f-738cf25ca8f9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:01.243484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:01.244560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:01.245434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 408/817] 10.222.0.46 () {56 vars in 1129 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:01.246329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.277109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.278061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.278342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.278608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.286225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.287694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:01.301958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:01.302941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 410/818] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:01.303956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.316994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.354692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239146a-17cd-48ea-8700-a4cbf3fc8ad2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.388623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.390577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.391553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.391851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.392132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/2f60f49044d04b0fb795873494fc8d34/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.406706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=2f60f49044d04b0fb795873494fc8d34, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.407462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028dfde-990b-4827-acdf-0cd8c766eb5c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.408175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.420685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 409/819] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:05:01 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/2f60f49044d04b0fb795873494fc8d34/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:01.432932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.445267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.446013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.446304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.446581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.447467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.449295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.480728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 411/820] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:01.480728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.554680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfa0c1-4d6b-4ec4-ac6f-eeefccb62eb4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.573040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.609957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.610650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.610934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.611208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.612081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:01.612426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.613981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.623805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c17120-064a-4a1c-b6d2-14943eea83a0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.629102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 410/821] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:01.630060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.676968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.677664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.677952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.678232 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.678961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:01.679277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.683239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.686661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 412/822] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:01.687509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.690399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.763007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1ba67-545e-4120-95bc-841775355ba3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.819677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.820216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39f21-ce74-490b-9c1b-1839bb43c500 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:01.820399 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.820718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.820998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.822029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:01.822343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.824753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.844651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 411/823] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:01.845488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.859181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:01.860098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:01.860496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:01.860852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/8a4c03a473c84329a4d982ef47ea0e52/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:01.862989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=8a4c03a473c84329a4d982ef47ea0e52, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:01.864831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:01.873604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.880740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 413/824] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:05:01 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/8a4c03a473c84329a4d982ef47ea0e52/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:01.881624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:01.954028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:01.987083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab415b-e005-43fb-9bb7-2f8e03bceaed None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.002518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06616-ed83-413f-ad72-e9786dde4b51 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.041412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.042296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.042730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.043117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.043652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.043975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:02.044328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.044427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.044641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.044942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.046109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.053513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 412/825] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:02.060748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:02.140974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.142809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.186679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:02.196473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a1271-2158-42a9-9655-db91b28428c1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.218525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:02.231174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.231846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.232128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.232402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.233176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.234574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.257138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 413/826] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:02.262579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 414/827] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:02.268819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:02.388958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d03967-c504-45fb-ac9b-8c4c0a0334de None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.426445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.427298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.427579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.427852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.440112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.441766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.450774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:02.464106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:02.465119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:02.466042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:02.466042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:02.466042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:02.466042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:02.466042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 414/828] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:02.472565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:02.575261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843f5c5-e67b-417d-b445-f0a4c3b1749f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.609313 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.609984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.610267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.610543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.611262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:02.611569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.612981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.629086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 415/829] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:02.630547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:02.741420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013d57-c86b-4ea6-bc1f-102f588d30bf None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.776680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.777567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.777851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.778119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.785302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.786793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:02.801715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:02.803671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:02.805953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 415/830] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:02.809158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:02.833981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:02.912292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cef15-949e-446d-989d-00e17455a1c7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:02.945701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:02.946380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:02.946664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:02.946937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:02.947723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:02.948032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:02.949542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340e68f-6dfa-486f-9eec-4056851c62d7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:02.961814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 416/831] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:02.969694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:03.030328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:03.075070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f66c-33cc-4010-82eb-b07db9340981 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:03.113090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:03.113760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:03.114040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:03.114312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:03.115159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=444a244a713944db9caf259034ccd231, user.id=12c6f9c481ec4108a86db440cc90311f) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:03.115469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:03.116960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaf356-0012-4ae5-a2d9-a0e7e3c7ebf0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:03.123545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 416/832] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:02 2022] GET /identity/v3/role_assignments?user.id=12c6f9c481ec4108a86db440cc90311f&scope.project.id=444a244a713944db9caf259034ccd231&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:03.747927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08e43-3604-410e-aec2-89479916e193 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:03.748502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08e43-3604-410e-aec2-89479916e193 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:03.748808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08e43-3604-410e-aec2-89479916e193 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:03.750528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 417/833] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:03.755933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:03.756422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:03.756573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:03.774047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:03.775237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:03.842195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 417/834] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:03.865101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08e43-3604-410e-aec2-89479916e193 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:03.946327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:03.965522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08e43-3604-410e-aec2-89479916e193 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:03.999879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.000656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.000943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.001226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.018037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:04.026294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:04.027378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:04.028453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 418/835] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:04.033684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.084385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.136261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679bc25-f104-42e2-9a52-1284fba9cae8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.171309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.172037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.172321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.172613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.173383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:04.173689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:04.175081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b88d1-8325-4564-8034-1087bc607db4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:04.183834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 418/836] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:04.189747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.203334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd099d4-aef9-4d2c-9c35-410e0be06f79 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.203621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd099d4-aef9-4d2c-9c35-410e0be06f79 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.203886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd099d4-aef9-4d2c-9c35-410e0be06f79 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.206649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 419/837] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:04.211146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eff29-c925-47db-ba5f-84171fef500f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.211146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eff29-c925-47db-ba5f-84171fef500f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.211146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eff29-c925-47db-ba5f-84171fef500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.229398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-496eff29-c925-47db-ba5f-84171fef500f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:04.230625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-496eff29-c925-47db-ba5f-84171fef500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:04.313271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b855f-eccf-4a7f-822b-d8837d839aaf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.320758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 420/838] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:04.345976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eff29-c925-47db-ba5f-84171fef500f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.356844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.358093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.358596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.359075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.371256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:04.373317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:04.375272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.389113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:04.395163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:04.396160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:04.397082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:04.397082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:04.397082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:04.397082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:04.404308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 419/839] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:04.405691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.450875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eff29-c925-47db-ba5f-84171fef500f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.486428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.487240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.487524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.487798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.499114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:04.507058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:04.508052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:04.508911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:04.513261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 421/840] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:04.514158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.519528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0972f8-66c3-4232-8a04-4d9b9d2973be None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.555275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.556266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.556757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.557193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.558075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:04.558583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:04.560154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:04.577671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 420/841] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:04.578777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.614728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffdc03-b6b7-47a2-8f41-72f602ecf774 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.617662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.635366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.653328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.654114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.654397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.654668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.655410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:04.655717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:04.657606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595e65-84e4-4587-b5df-ac489700ded4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:04.666112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 422/842] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:04.670473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b602f1-c545-472e-aaa7-4d0adecef5b5 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.670838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b602f1-c545-472e-aaa7-4d0adecef5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.671126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b602f1-c545-472e-aaa7-4d0adecef5b5 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.676373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 423/843] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:04.676373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b602f1-c545-472e-aaa7-4d0adecef5b5 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.690612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a072-f8ba-4112-b83f-5e73a1813f4d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.725220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.726054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.726338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.726615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.733890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:04.735395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-23e6f353-f3d8-4bc6-8908-4f48d64d0736 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:04.751325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:04.752792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:04.753740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 421/844] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:04.754320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.754975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.754975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.773240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:04.774427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:04.782616 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b602f1-c545-472e-aaa7-4d0adecef5b5 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.823593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.824729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.825018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.825348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.836941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:04.838390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:04.848632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 422/845] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:04.848632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:04.868948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:04.870040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:04.871055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:04.871055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:04.871055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:04.871055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:04.871055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 424/846] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:04.871395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:04.889949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.901915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:04.960051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee50c-6887-4b3e-b3b7-15e9abf89987 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.972757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbee172-235e-4bc7-afa7-b2e41ce7dd26 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:04.997651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:04.998340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:04.998622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:04.998895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:04.999741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:05.000048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.001535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.007700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.008514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.008838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.009111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.009767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.011180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.020976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 423/847] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:05.022112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:05.023483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:05.024482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:05.025966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:05.029627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 425/848] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:05.030482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.119744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.132817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9d915-570d-40ce-a9bc-d120e8cec205 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.134480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.139520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd506c-7cad-43f4-af0e-c57012ba42fa None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.172400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.173293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.173882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.174167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.175173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:05.175487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.177583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.181748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.182412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.182696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.182972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.190771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 424/849] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:05.191863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.271456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.273355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.308239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abe0cf-e280-4e7f-92a8-deb055303045 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.346243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.347001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.347186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.347478 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.348201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:05.348480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.349941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.355689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 425/850] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:05.356199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.367519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.385796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.389407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 426/851] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:05.390381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.467283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aecb3e-8e74-4574-8ca9-1974ffb2b2e6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.494077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541caa68-ae2a-406a-943d-e55ec9b90474 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.500959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.501773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.502056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.502332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.509681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.511185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:05.526292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:05.527524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 426/852] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:05.528571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.530983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.531682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.531965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.532276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.533012 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:05.533324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.534720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38aad-ccf3-49e6-8f95-d89563cfd2ec None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.539507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 427/853] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:05.540755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54219a-bc26-431c-9158-5704f0278149 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.541042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54219a-bc26-431c-9158-5704f0278149 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.541322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54219a-bc26-431c-9158-5704f0278149 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.542529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 428/854] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:05.543306 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54219a-bc26-431c-9158-5704f0278149 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.602970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.638934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.656678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1696d6-69ce-49ac-aa57-8a22b294821f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.671582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54219a-bc26-431c-9158-5704f0278149 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.699675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.700980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.701528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.702020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.708635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.709333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.709615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.709888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.710754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:05.711061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.712541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825336-ec61-4bfd-89e6-a5301afd5957 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.714491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.716074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.733565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 429/855] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:05.734542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.734824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:05.735047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:05.735966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:05.737465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:05.737465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:05.737465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:05.737465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:05.737776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.737999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 427/856] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:05.739875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.760401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:05.761677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:05.844649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 430/857] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:05.844649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:05.868412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2610d-e6d7-4d35-8758-e7bb05d3ddbc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.875369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.903964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.904660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.904951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.905231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.914699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:05.946848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f845ed2-327c-4e4d-9a55-d6d8de5e5471 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:05.977022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.978497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.982780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:05.983464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:05.983742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:05.984017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:05.984780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:05.985087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:05.986472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:05.998696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 431/858] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.000157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.083036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 428/859] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:06.084016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.105366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.115004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a4c0-16c5-4e81-bb83-0558a9cc6c09 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.127381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.149320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.150252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.150614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.150959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.151653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.153237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:06.165635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:06.166651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:06.167533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 432/860] 10.222.0.46 () {56 vars in 1132 bytes} [Mon May 23 17:05:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:06.168485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.196001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b6f40-cded-499e-9ee3-9959cfbad16b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.229939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.230810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.231101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.231379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.238039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.239507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:06.253343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:06.254293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:06.255302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 429/861] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:06.255825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.279616 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228535c-5d03-4143-a27f-8d8443fafdd3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.315363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.316280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.316567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.316869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.329019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.330615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:06.349257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:06.350225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:06.351149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:06.351149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:06.351149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:06.351149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:06.351149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 433/862] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:06.351429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.356829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.363469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9f8e-f3de-4577-bc94-485ccb158224 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.365449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.405060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.406178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.406609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.407282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.408155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:06.408643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.410575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.420970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 430/863] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.420970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.462722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b201f-d890-4360-acb4-1aaf889e94ad None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.497407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.498514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.498804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.499084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.500245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:06.500562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.502399 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.519909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 434/864] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.519909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.529294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46466787-1594-4f2b-b831-51960b3b2014 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.566100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.567081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.567563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.567848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.568675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:06.568988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.570499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.585058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 431/865] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.585987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.587006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.617923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.636866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc41e5-2dde-4a0b-87a5-57f7de73dcbd None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.674908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.675560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.675838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.676055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.677970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:06.677970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.679833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.692638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 435/866] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.692638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:06.710445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90b6b-afa3-445d-b7fa-a55d69e6cc5e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.754284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.754936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.755292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.755644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.756612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=2f60f49044d04b0fb795873494fc8d34) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:06.757361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.758632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.766389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 432/867] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/role_assignments?user.id=2f60f49044d04b0fb795873494fc8d34&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:06.833706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdeaab-730a-4d1a-a7d7-57e7751a3b21 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:06.872707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:06.879916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:06.881148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:06.881688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:06.882152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:06.891309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:06.893197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:06.909232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:06.910169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:06.911054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:06.913216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 436/868] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:06.919388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:07.033968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:07.051839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239d29-129c-4c5d-9819-d20122809807 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:07.087848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:07.088532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.088844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.089130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.089968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:07.090274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:07.091735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9ec27-8a94-44ec-a927-504d46abbbc7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:07.104371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 433/869] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:07.109986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:07.217628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1d66d-798b-485f-bd51-1f2bb7d2a714 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:07.251804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:07.252468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.252780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.253057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.253895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=444a244a713944db9caf259034ccd231, user.id=8a4c03a473c84329a4d982ef47ea0e52) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:07.254204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:07.255659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f346ea-71a0-4295-a7c3-f5d36a092218 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:07.262216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 437/870] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:07 2022] GET /identity/v3/role_assignments?user.id=8a4c03a473c84329a4d982ef47ea0e52&scope.project.id=444a244a713944db9caf259034ccd231&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:07.797782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84bfaf-422b-4e7c-af18-2ef4269e4330 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.798076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84bfaf-422b-4e7c-af18-2ef4269e4330 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.798191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84bfaf-422b-4e7c-af18-2ef4269e4330 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.799726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 434/871] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:07.805527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910f11-4dbb-4930-911d-777f715ea1d9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:07.806048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910f11-4dbb-4930-911d-777f715ea1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:07.806546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910f11-4dbb-4930-911d-777f715ea1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:07.823656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ed910f11-4dbb-4930-911d-777f715ea1d9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:07.825252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ed910f11-4dbb-4930-911d-777f715ea1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:07.878611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:07.896442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 438/872] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:07.919190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84bfaf-422b-4e7c-af18-2ef4269e4330 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:08.027261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84bfaf-422b-4e7c-af18-2ef4269e4330 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:08.065283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c454c-de2c-4452-879a-8a5bc6405a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:08.066390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c454c-de2c-4452-879a-8a5bc6405a0d None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:08.066955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c454c-de2c-4452-879a-8a5bc6405a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:08.067440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c454c-de2c-4452-879a-8a5bc6405a0d None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:08.068383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c454c-de2c-4452-879a-8a5bc6405a0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:08.070006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c454c-de2c-4452-879a-8a5bc6405a0d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:08.092806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 435/873] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:07 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:09.021330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ec46-1539-401b-8da2-764b9d808d5d None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.021859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ec46-1539-401b-8da2-764b9d808d5d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.021859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ec46-1539-401b-8da2-764b9d808d5d None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.023532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 439/874] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:09.030203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.030646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.030847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.042669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:09.051216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:09.053355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:09.141521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 436/875] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:09.168692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776fb70-02c9-490a-9685-d229757a6037 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.169065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776fb70-02c9-490a-9685-d229757a6037 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.169548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776fb70-02c9-490a-9685-d229757a6037 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.170675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.171553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 440/876] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:09.176772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.177061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.177341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.195168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:09.196381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:09.264042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 441/877] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:09.282448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547218e4-096c-439f-bb74-90625c282ab7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:09.289744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.321342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:09.324653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae98a0-2b98-4a68-a934-57d0e7c238a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:09.325379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae98a0-2b98-4a68-a934-57d0e7c238a1 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.325786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae98a0-2b98-4a68-a934-57d0e7c238a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.326068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae98a0-2b98-4a68-a934-57d0e7c238a1 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.326988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae98a0-2b98-4a68-a934-57d0e7c238a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:09.328398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae98a0-2b98-4a68-a934-57d0e7c238a1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:09.345406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 437/878] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:09 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:05:09.412294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce72e85-3a83-4810-8b7d-8bef80c28598 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:09.432527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:09.458668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:09.459657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.459950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.460231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.472581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:09.481776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:09.482809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:09.483654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 442/879] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:09.489340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07915b-94e5-4e25-ac9a-0de4ae0845d6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.489637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07915b-94e5-4e25-ac9a-0de4ae0845d6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.490006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07915b-94e5-4e25-ac9a-0de4ae0845d6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.491597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.491792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 438/880] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:09.497059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.497350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.497632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.515626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:09.516904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:09.593950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 439/881] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:09.615954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.626279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab80f4-fd52-478e-ac11-80dd792bede7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:09.661728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:09.663059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.663779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.664205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.665403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:09.665865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:09.668204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:09.684558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 443/882] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:09.686029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.728655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3824a-1c48-487c-90b4-d45977e614c1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:09.734554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:09.756288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:09.771321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:09.772351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.772720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.772999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.773757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:09.775148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:09.788234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:09.789501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:09.790528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:09.795307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 440/883] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:09.795806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.827645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc1b2a-db60-4d0a-9044-e9529c204b69 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:09.872899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:09.873744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.874029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.874307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.889438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:09.892071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:09.908038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194365c2-843e-4277-aee7-11f4a6f4f8f1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:09.918327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:09.919287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:09.920190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:09.920190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:09.920190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:09.920190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:09.927550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 444/884] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:09.928131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:09.955617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:09.957271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:09.957795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:09.958425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:09.959647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:09.960372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:09.962180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:09.968984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 441/885] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:09.974866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.025715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.032514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.046470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7b03f-89ad-46eb-b00a-65aa98aed245 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.083845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879cbf1-3d76-4a3a-b7f5-c12e8563c230 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.084722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.085708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.086173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.086722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.087643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:10.088235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.089879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.103430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 445/886] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:10.109892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.123927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.125110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.125631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.126101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.127056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:10.127575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.129228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.134643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 442/887] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:10.241652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23511de1-cf4a-4c5a-a994-35fcc47f6be1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.280556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.281868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.282401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.282884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.291454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.293443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-eed2cb50-30d0-46c0-9470-b8d5ccd793d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:10.310161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:10.311190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:10.312140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:10.315009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 446/888] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:10.321147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.420461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3618c-37d3-4713-9d26-17957c38acd9 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.422022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3618c-37d3-4713-9d26-17957c38acd9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.422022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3618c-37d3-4713-9d26-17957c38acd9 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.425045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 447/889] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:10.429085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.429377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.429661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.431807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd623ed-1e06-4071-a893-a6e3d31f7184 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.440567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.446866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:10.448074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:10.448687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.479176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.479648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.479932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.480246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.481115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:10.481430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.483084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.501968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 443/890] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:10.507460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.526245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 448/891] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:10.549974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.616040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e23d0-0dc3-4c0c-9baf-c044e362be91 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.660419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.661942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.662432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.663169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.675417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ab55e-006b-4ae6-b197-4c3eb322035d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.720523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.722858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.723735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.724041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.724312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.725318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.726804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.729676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:10.740679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:10.741738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:10.743088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 449/892] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:10.750276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.752845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.754398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.858406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 444/893] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:05:10.863565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.866408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58d5aa-0847-4312-8764-a4d8276c552b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.904557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:10.905632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:10.906133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:10.906704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:10.907731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:10.908254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:10.909901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:10.920479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 450/894] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:10.922039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:10.948231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:10.987868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827a9f-691d-4fa0-bcc2-f87a8e180c73 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:10.992828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:11.028233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.029078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.029373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.029643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.040137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.041657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.045479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2090ff-8c2c-422d-a1fe-ec7038767a40 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:11.060535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:11.061510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:11.062372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:11.062372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:11.062372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:11.062372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:11.066491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 445/895] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:11.067945 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.088436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.089854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.090344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.090844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.091785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:11.092639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.094446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.101509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 451/896] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:11.109031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.181028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16059a7-22a6-43f7-8291-51506f71bef3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.209412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:11.223316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.224236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.224634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.225132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.225959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:11.226442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.228135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.234436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df948c6-0039-40b0-9dfa-74e3a3e6f179 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.245152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 446/897] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:11.246711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.270620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:11.277859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.278867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.279473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.279904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.281566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] RBAC: Adding query filter params (interface=public, service_id=2bfe7ef022e34aadba657733000cca60, region_id=RegionOne) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:11.282029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.283722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.294070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 452/898] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/endpoints?service_id=2bfe7ef022e34aadba657733000cca60&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:11.300237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.363420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700bb4-a77a-40f9-b13f-637a1cff6129 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.406818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.407540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.407826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.408096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.415285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.416795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.421894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8941419-5f96-4235-87db-60ca3eb34357 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:11.431346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:11.432243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:11.433150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:11.437455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 447/899] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:11.438341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.468489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.469667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.470330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.471458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.472770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.474685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.489290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 453/900] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:05:11.497015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:11.556309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6ac3-6bfd-4b85-a989-634433a4d63d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.595723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.596489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.596888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.597173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.598059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:11.598424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.600026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e198ca-918d-41e6-b879-10f97a17beec None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.613900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 448/901] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:11.620318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.657567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fab3-d7d1-4cc6-9900-4fa58086586a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.657947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fab3-d7d1-4cc6-9900-4fa58086586a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.658131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fab3-d7d1-4cc6-9900-4fa58086586a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.659823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 449/902] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:11.667598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.668020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.668269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.690069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:11.690282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:11.691885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:11.744476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3f7e-be23-4976-9849-04ee978d9b64 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.786914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.787599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.787881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.788156 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.789097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] RBAC: Adding query filter params (role.id=fac8c417a83045f3b95ff252705df98a, scope.project.id=444a244a713944db9caf259034ccd231, user.id=2f60f49044d04b0fb795873494fc8d34) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:11.789429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.790018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 450/903] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:11.790922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.800325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 454/904] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/role_assignments?user.id=2f60f49044d04b0fb795873494fc8d34&scope.project.id=444a244a713944db9caf259034ccd231&role.id=fac8c417a83045f3b95ff252705df98a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:11.821856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:11.862175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:11.937755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22753-c7af-4aa5-8057-a75febe5fd63 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:11.979873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:11.984654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:11.984654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:11.984654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:11.984654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:11.984654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:11.997773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:11.998753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:11.999583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 451/905] 10.222.0.46 () {56 vars in 1132 bytes} [Mon May 23 17:05:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:12.007349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:12.116185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3dba3-64f5-4260-a145-8bfbbd916c18 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:12.137968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:12.157817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:12.158860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.159379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.159849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.160793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:12.161293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:12.162888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:12.168575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 455/906] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:12.180643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:12.274077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:12.278400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba6942-dac2-4383-a7e4-8a9e74857c5d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:12.316535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:12.317257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.317605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.317888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.318663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:12.318985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:12.320398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79472726-bf81-4865-a0aa-7378dc53a20f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:12.325985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 452/907] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:12.331787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:12.438098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b10ea-350c-4ab2-8eb0-f2e56e106dcc None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:12.465401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b03d83-d998-403c-add9-2804f09bae72 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.465751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b03d83-d998-403c-add9-2804f09bae72 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.466044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b03d83-d998-403c-add9-2804f09bae72 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.467676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 453/908] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:12.473575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.473972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.474349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.477775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:12.478620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.479061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.479485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.480451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] RBAC: Adding query filter params (interface=public, service_id=18985dd6e0074c7aaecf593ae0eb70dd, region_id=RegionOne) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:12.480928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:12.482460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:12.488431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 456/909] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:05:12 2022] GET /identity/v3/endpoints?service_id=18985dd6e0074c7aaecf593ae0eb70dd&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:12.493456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:12.499557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:12.500815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:12.559495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:12.588649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 454/910] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:12.609239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:12.622568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f2cd-ea81-4190-8cab-f205453ad5c1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:12.665138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511f24-0fab-42c9-9bef-8f460f1dbb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:12.666453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511f24-0fab-42c9-9bef-8f460f1dbb2d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.667106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511f24-0fab-42c9-9bef-8f460f1dbb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.667625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511f24-0fab-42c9-9bef-8f460f1dbb2d None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.668786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511f24-0fab-42c9-9bef-8f460f1dbb2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:12.670400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511f24-0fab-42c9-9bef-8f460f1dbb2d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:12.684858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 457/911] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:05:12 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:05:12.724267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:12.733904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b08f-bb9a-42bd-8f10-dc8bc29aca1b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:12.770968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40a74-c02d-49d5-92c3-3876da5682c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:12.771669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40a74-c02d-49d5-92c3-3876da5682c1 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:12.771954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40a74-c02d-49d5-92c3-3876da5682c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:12.772241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40a74-c02d-49d5-92c3-3876da5682c1 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:12.773005 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40a74-c02d-49d5-92c3-3876da5682c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:12.774515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40a74-c02d-49d5-92c3-3876da5682c1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:12.798204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 455/912] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:12 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:05:13.819901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d81fd6-76c0-4a02-a71e-37c18f0cd34b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:13.820376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d81fd6-76c0-4a02-a71e-37c18f0cd34b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:13.820587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d81fd6-76c0-4a02-a71e-37c18f0cd34b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:13.822149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 458/913] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:13.827618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23862d6c-1217-4e15-8df8-8106cb735a88 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:13.828040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23862d6c-1217-4e15-8df8-8106cb735a88 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:13.828207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23862d6c-1217-4e15-8df8-8106cb735a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:13.847282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-23862d6c-1217-4e15-8df8-8106cb735a88 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:13.848540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-23862d6c-1217-4e15-8df8-8106cb735a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:13.933147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 456/914] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:13.955946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d81fd6-76c0-4a02-a71e-37c18f0cd34b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.058579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d81fd6-76c0-4a02-a71e-37c18f0cd34b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.071476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:14.092141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92bfb9-c101-4e88-a89c-2eab50e2da8b None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.092507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.093009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92bfb9-c101-4e88-a89c-2eab50e2da8b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.093434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.093725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.093914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92bfb9-c101-4e88-a89c-2eab50e2da8b None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.094008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.094655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:14.096026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 457/915] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:14.096129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:14.101351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.101873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.102367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:14.108977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:14.109955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:14.110804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 459/916] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:14.116211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.122990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:14.124570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:14.212624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 458/917] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:14.233486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.246602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:14.248185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e10854-3e04-4931-aff5-f785025f3dd2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.292798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.293790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.294471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.294960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.296406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:14.296997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:14.299146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:14.305537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 460/918] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:14.312679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.356323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193498b0-b454-4c28-96ad-58cf02b54d75 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.366939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:14.395568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.396405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.396799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.396999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.407955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:14.416352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:14.417363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:14.418281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:14.422420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 459/919] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 17:05:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:14.423321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.449891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e2e5-635a-4345-82d0-3f5773bccbff None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.487243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.487929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.488249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.488531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.489571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:14.489571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:14.490975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:14.500932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 461/920] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 17:05:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:14.502270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.511024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:14.546760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542e8b4-b421-4dd6-864a-a6de25adef89 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.584982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.585597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.585885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.586311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.587070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:14.587373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:14.588881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:14.602735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 460/921] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:05:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:14.603692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.637671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fe621-c4db-4e7b-892e-3304758dabaa None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.641788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:14.675907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.676767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.677122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.677488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.678170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:14.679574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:14.708626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 462/922] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:14.733239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ca5fd-744b-4930-b8b1-cfe004f5703f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.768225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:14.789093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:14.789968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:14.790254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:14.790523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:14.810044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:14.811604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f21a0faa-0dec-4478-8fa2-ed37cedb6bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:14.832545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:14.834108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:14.835046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:14.835046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:14.835046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:14.835046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:14.835046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 461/923] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:14.840675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:14.964324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bbd3-2154-4b37-8fcb-57d81ab63fb8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:14.999498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.000181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.000465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.000770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.001506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:15.001817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.003396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341737e-45e9-44b1-95aa-ca67bc45d5ea None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.013471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43167e-916e-416c-b7f0-c18a2efe6a5f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.013761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43167e-916e-416c-b7f0-c18a2efe6a5f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.014043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43167e-916e-416c-b7f0-c18a2efe6a5f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.016021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 462/924] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:15.017989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 463/925] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:15.022960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43167e-916e-416c-b7f0-c18a2efe6a5f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.024397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a683f5-8aaf-4573-b255-23d870607fe6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.024725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a683f5-8aaf-4573-b255-23d870607fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.025002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a683f5-8aaf-4573-b255-23d870607fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.041593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c6a683f5-8aaf-4573-b255-23d870607fe6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:15.042823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c6a683f5-8aaf-4573-b255-23d870607fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:15.057710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.114204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 464/926] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:15.115485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0bf6-d053-4bb2-8fe1-57bab8e3c8b5 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.115775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0bf6-d053-4bb2-8fe1-57bab8e3c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.116054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0bf6-d053-4bb2-8fe1-57bab8e3c8b5 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.120679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 465/927] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:15.122796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.123143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.123452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.138053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43167e-916e-416c-b7f0-c18a2efe6a5f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.142207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:15.143410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:15.176565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.177422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.177709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.177988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.186613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.188097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:15.207162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:15.208337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 463/928] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:15.214454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.220154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 466/929] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:15.221095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.260325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.302887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.323749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d578-4b5d-440a-935c-0d79cce5e7b7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.324816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0186ab-ddea-4b04-83be-ebd87a2cc61a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.358095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.358773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.359054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.359258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.359366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.360145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:15.360335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.360453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.360810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.361192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.361935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.362022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.363467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:15.376167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:15.377295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.383152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 464/930] 10.222.0.46 () {56 vars in 1132 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:15.384186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.384268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 467/931] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:15.386894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.490900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206cd29-8999-4c8d-93bc-b592d3710989 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.492559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.493950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fd22-7d79-4d4b-996f-7b3289470845 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.530161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.530847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06247591-be70-485d-abc9-c7125e64721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.531054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.531404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.531745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.531952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06247591-be70-485d-abc9-c7125e64721d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.532310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06247591-be70-485d-abc9-c7125e64721d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.532697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06247591-be70-485d-abc9-c7125e64721d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.532805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:15.533136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.533642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06247591-be70-485d-abc9-c7125e64721d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.534654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.535182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06247591-be70-485d-abc9-c7125e64721d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.545657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 468/932] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:15.545657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.547360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-06247591-be70-485d-abc9-c7125e64721d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:15.549681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:15.550912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:15.551852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:15.556402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 465/933] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:15.566144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06247591-be70-485d-abc9-c7125e64721d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.659600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beed43c-ed18-4d75-92c1-62fd8ab6eb9f None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.677758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06247591-be70-485d-abc9-c7125e64721d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.692847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.693656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.693940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.694215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.704761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.706240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.712076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.712795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.713082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.713365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.714079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:15.714514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.716075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.725471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 466/934] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:15.725471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:15.725705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:15.726691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:15.727771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:15.727771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:15.727771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:15.727771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:15.727771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 469/935] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:15.729703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.760867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.791553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:15.837218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5e2f9-d2fb-458c-a756-c9017485fd5d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.845295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e876-128f-4edf-9443-5409c318d9db None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:15.872114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.873037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.873527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.873908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.874723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:15.875112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.877318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.881559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:15.882233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:15.882504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:15.882775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:15.888307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 467/936] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:15.888501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:15.888639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:15.888743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:15.912075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 470/937] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:15.912896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:16.037277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:16.042931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd9c46-8b50-4f68-8b6c-f609696a1ea2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.043474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a858a-5c5a-4a8d-a2e6-0a07b1396c37 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.052864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:16.092750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.093358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.093577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.093970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.094309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.094824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.095168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:16.095466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.095578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.096034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.096968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:16.097215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.097635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.099247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.105657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 471/938] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:16.114163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:16.121036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 468/939] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:16.122952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:16.237271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39e822-a03f-4a64-a262-b7596bc8564b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.258809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385591f4-9ccc-4989-ae0c-959345e50707 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.276378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.277549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.278040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.278547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.279656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] RBAC: Adding query filter params (interface=public, service_id=690bc38a7de349c19c2b612c14d534e8, region_id=RegionOne) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:16.280265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.281907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.288149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 472/940] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:05:16 2022] GET /identity/v3/endpoints?service_id=690bc38a7de349c19c2b612c14d534e8&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:16.294125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:16.299068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.299950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.300234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.300515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.309279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.311084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:16.330093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:16.331050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:16.331963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:16.336781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 469/941] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:16.339164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:16.341097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:16.360987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:16.435329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64891-5745-4c56-ab25-94e3faa41bc5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.459569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182c1e-62d8-44df-b91a-9714092cd85c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.480824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.481647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.482027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.482427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.483727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.485907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.500717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 473/942] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:05:16 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:05:16.503964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.504710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.504994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.505271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.506164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:16.506511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.508214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3868-7a7d-4bc4-a341-edd1a8aad7b5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.526275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 470/943] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:16.532394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:16.645677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:16.650122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce332e-cdfd-4766-af36-a6a915f549c2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:16.688586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba31e7-9ece-47f7-8a2e-738385a0da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:16.689646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba31e7-9ece-47f7-8a2e-738385a0da48 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:16.689929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba31e7-9ece-47f7-8a2e-738385a0da48 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:16.690259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba31e7-9ece-47f7-8a2e-738385a0da48 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/2f60f49044d04b0fb795873494fc8d34/roles/fac8c417a83045f3b95ff252705df98a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:16.693474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba31e7-9ece-47f7-8a2e-738385a0da48 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=2f60f49044d04b0fb795873494fc8d34, role_id=fac8c417a83045f3b95ff252705df98a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:16.695448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba31e7-9ece-47f7-8a2e-738385a0da48 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:16.711221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 474/944] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:05:16 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/2f60f49044d04b0fb795873494fc8d34/roles/fac8c417a83045f3b95ff252705df98a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:17.033230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be41e5-3e28-4560-bcaf-e6a0bec739af None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:17.033757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be41e5-3e28-4560-bcaf-e6a0bec739af None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:17.033866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be41e5-3e28-4560-bcaf-e6a0bec739af None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:17.035280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 471/945] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:17.040830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:17.041641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:17.042120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:17.059869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:17.061398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:17.131770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 475/946] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:17.156033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be41e5-3e28-4560-bcaf-e6a0bec739af None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:17.236567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:17.265918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be41e5-3e28-4560-bcaf-e6a0bec739af None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:17.303960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:17.304768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:17.305056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:17.305335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:17.306114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:17.307640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:17.309165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING keystone.server.flask.common [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 17:05:17.328843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.sql.core [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 17:05:17.328843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 17:05:17.328843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [parameters: {'id': 'b3d0550e6f134d41ae5b54df8c3071a0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 17:05:17.328843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80556) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3d0550e6f134d41ae5b54df8c3071a0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3d0550e6f134d41ae5b54df8c3071a0. May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application conn.query(q) May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:05:17.336668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result.read() May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 17:05:17.337466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application next(self.gen) May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application yield resource May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application next(self.gen) May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.session.rollback() May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.force_reraise() May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise self.value May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application session.commit() May 23 17:05:17.338448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._prepare_impl() May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.session.flush() May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._flush(objects) May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application compat.raise_( May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application flush_context.execute() May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 17:05:17.339371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rec.execute(self) May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 17:05:17.340289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application conn.query(q) May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result.read() May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:05:17.341122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [parameters: {'id': 'b3d0550e6f134d41ae5b54df8c3071a0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:17.342013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:17.342796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3d0550e6f134d41ae5b54df8c3071a0. May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:17.343702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 472/947] 10.222.0.46 () {60 vars in 1140 bytes} [Mon May 23 17:05:17 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:17.344223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:17.440134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:17.454472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a903d-5368-4ea2-8523-a5e4d26cb764 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:17.489578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:17.490393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:17.490676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:17.490953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:17.498323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:17.499859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-8a1d5a98-b6ef-452f-84ee-558af900160e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:17.514137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:17.516463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:17.518518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 476/948] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:17.522373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:17.631248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcde70-2430-4170-8868-fa6917acaf6f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:17.660384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:17.666575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:17.667260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:17.667632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:17.667911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:17.668709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:17.669257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:17.671365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99ffa-1f97-4eba-b907-a763e51958d6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:17.692311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 473/949] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:18.228050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6a0c-2bea-4f94-88c4-33ed881e982e None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.228584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6a0c-2bea-4f94-88c4-33ed881e982e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.228718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6a0c-2bea-4f94-88c4-33ed881e982e None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.231529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 477/950] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:18.236071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.236508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.236726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.254610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:18.256145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:18.325950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 474/951] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:18.348333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6a0c-2bea-4f94-88c4-33ed881e982e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:18.455535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6a0c-2bea-4f94-88c4-33ed881e982e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:18.490181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:18.491365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.491865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.492335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.493569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:18.495329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:18.508070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:18.509357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:18.510250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:18.513227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 478/952] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:18.522134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:18.631097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e44c7-758a-4a33-8f5a-c9b82133748f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:18.652229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:18.668450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:18.669209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.669502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.669779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.670520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:18.670835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:18.672315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db57d9-8317-4fd6-9722-0d69288c29a0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:18.678706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 475/953] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:18.685027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:18.702654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:18.790763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4fbd5-acb3-4b74-8ec8-fe40226ad282 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:18.829026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:18.830100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.830606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.831081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.832004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:18.832642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:18.834284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bca6a-6df9-4fbd-8a6a-72109203de32 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:18.840219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 479/954] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:18.875205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74a85a-ae8b-4f9a-8174-5804c692e067 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.875498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74a85a-ae8b-4f9a-8174-5804c692e067 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.875832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74a85a-ae8b-4f9a-8174-5804c692e067 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.877523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 476/955] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:18.885464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:18.886001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:18.886522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:18.904808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:18.906272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:18.982004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 480/956] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:19.003827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0677d04-5abc-4f07-a262-63feeee3626e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.004115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0677d04-5abc-4f07-a262-63feeee3626e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.004397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0677d04-5abc-4f07-a262-63feeee3626e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.005261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.006118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 477/957] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:19.012050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.012351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.012642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.014274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.035990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:19.037549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:19.112723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 478/958] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:19.134768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dda406-6ffa-4c54-bd71-d93837adac33 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.136105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.179417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.180292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.180578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.180904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.181858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.183891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:19.198090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:19.199343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:19.200164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:19.203045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 481/959] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:19.208937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.242190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a081-33d2-4387-b17e-f2956418379d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.261101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.282382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.283600 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.284109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.284586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.291433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.296281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:19.304904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:19.305833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:19.306689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:19.312806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 479/960] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:19.315498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.331838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de33d86-5f15-409e-9540-3947fa3f0c6b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.378221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.379496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.380234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.380769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.382371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:19.382905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.385364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.393734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 482/961] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:19.400701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.427450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84efc3d-ebcd-448b-bcce-08d4e4485cbf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.465272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.466145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.466530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.466905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.467766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:19.468171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.469690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.479120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 480/962] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:19.485694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.524415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e309539-deed-45da-936a-4efff00fadd9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.528321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.565495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.566461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.566893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.567314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.568173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:19.568658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.570200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.571678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.577088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 483/963] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:19.583508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.602798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f297-54aa-4cd8-9b34-d4a22068c946 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.638843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.639580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.639869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.640509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.652219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.653752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:19.671702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:19.672851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:19.673935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:19.673935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:19.673935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:19.673935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:19.677700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 481/964] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:19.678595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.695511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3d526-b97d-468b-814b-1728b7e498b1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.731589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.732627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.733080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.733550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.734438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.735992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.765327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 484/965] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:19.774746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.789994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95e03-1486-480b-b5d4-d54f69cdbc37 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:19.836186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:19.836944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:19.837234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:19.837518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:19.838280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:19.838594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:19.840105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:19.854361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 482/966] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:19.860161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:19.932805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:19.984928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64101d-c6e3-45f2-b2a4-315039634bd9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.020657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.021762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.022211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.022633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.031130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.032969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-e25b90fd-b609-4a13-8a15-e2d7bd3f00a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:20.049379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:20.050609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:05:20.051771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.054267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 485/967] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:05:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:20.060405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.085562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7172a3-16cd-4d8c-b126-82769403a3a2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.085919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7172a3-16cd-4d8c-b126-82769403a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.086119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7172a3-16cd-4d8c-b126-82769403a3a2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.088802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 486/968] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:20.092866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.093160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.093439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.110887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:20.112079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:20.185491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 487/969] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:20.185952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a672c-37c7-4592-a58f-1edcb788d1ab None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.209254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.226242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.227499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.228303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.228761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.229764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:20.230272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.232738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.257024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:20.257806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 483/970] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:20.262899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.267693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:20.329215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc5e1a-b506-410e-bdee-49da0728ada4 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.371631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.372315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.372647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.373056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.373786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.375570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.376945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING keystone.server.flask.common [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 17:05:20.391617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ced28-b6d7-4597-b4b4-d51b32835f77 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.396342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.sql.core [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 17:05:20.396342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 17:05:20.396342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [parameters: {'user_id': '6af4901c8e0945788ed1441abcd64446', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 17:05:20.396342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80557) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application conn.query(q) May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application result.read() May 23 17:05:20.417151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:05:20.418199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application next(self.gen) May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application yield resource May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application next(self.gen) May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self.session.rollback() May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self.force_reraise() May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise self.value May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application session.commit() May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 17:05:20.419160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._prepare_impl() May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self.session.flush() May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._flush(objects) May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application compat.raise_( May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application flush_context.execute() May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rec.execute(self) May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 17:05:20.420069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:05:20.420990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application conn.query(q) May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application result.read() May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:05:20.421827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [parameters: {'user_id': '6af4901c8e0945788ed1441abcd64446', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:20.422643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 17:05:20.424446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 488/971] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 17:05:20 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:20.426720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.436380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.437434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.437434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.437630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.508698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.510220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.512551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:20.540904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ac76-e49b-40de-9aa5-01303fb8033a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.549444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:20.583268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.584588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.585161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.585662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.594760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.596914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:20.612781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:20.613768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:05:20.614689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:20.621326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 484/972] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:20.622093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 489/973] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:20.623024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.629787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.726987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45375cb-3fd0-4dfc-9022-7b4790a94ea8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.728474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:20.743851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe110b-51ea-4830-92c6-26babcdf4d4a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.764198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.765412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.765701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.765981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.777131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.778615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.781793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.782704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.788842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.789555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.790621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:20.791144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.798064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:20.798777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:20.799623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:20.800500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:20.800500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:20.800500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:20.800500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:20.804889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 485/974] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:20.805814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:20.843242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 490/975] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:20.918065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c97449-49dc-4c5a-827d-f2d910532ea7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:20.966683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:20.967796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:20.968295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:20.968829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:20.970285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:20.970838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:20.972473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:20.986297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 486/976] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:20.993848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:21.024844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:21.109417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4b1e3-4586-462b-ab47-c718d483ef6b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:21.145132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:21.145941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:21.146225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:21.146500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:21.154562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:21.156051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-321dae9d-1d8d-4f51-bebb-fd83776a534f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:21.170875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:21.171813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:21.172807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 491/977] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:21.178673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:21.198184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:21.250819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15a63-ff72-4099-bbc7-afe6e788a190 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:21.251387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15a63-ff72-4099-bbc7-afe6e788a190 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:21.252941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15a63-ff72-4099-bbc7-afe6e788a190 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:21.253656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 492/978] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:21.259899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:21.260255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:21.262048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:21.285570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:21.287143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:21.290446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070e8b-a727-4901-89f8-61a23550c91e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:21.328329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:21.329210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:21.329612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:21.330008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:21.330963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:21.331398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:21.333062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:21.346813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 487/979] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:21.352778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:21.365135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 493/980] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:21.386978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:21.404445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:21.437282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:21.463937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc14f-00f9-4d38-85cc-485d6932efca None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:21.501106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:21.501344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b9b6-a0d4-4525-b019-759438e4027f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:21.501710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:21.502016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:21.502294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:21.503125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] RBAC: Adding query filter params (role.id=fac8c417a83045f3b95ff252705df98a, scope.project.id=444a244a713944db9caf259034ccd231, user.id=2f60f49044d04b0fb795873494fc8d34) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:21.504147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:21.504898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1978-ccde-4019-aa55-f614c3d2b57c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:21.511378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 488/981] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:21 2022] GET /identity/v3/role_assignments?user.id=2f60f49044d04b0fb795873494fc8d34&scope.project.id=444a244a713944db9caf259034ccd231&role.id=fac8c417a83045f3b95ff252705df98a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:21.541024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83217-ddfa-4c95-b625-e99f60c99f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:21.541731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83217-ddfa-4c95-b625-e99f60c99f69 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:21.541996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83217-ddfa-4c95-b625-e99f60c99f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:21.542318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83217-ddfa-4c95-b625-e99f60c99f69 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:21.543091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83217-ddfa-4c95-b625-e99f60c99f69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:21.544591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83217-ddfa-4c95-b625-e99f60c99f69 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:21.565312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 494/982] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:21 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:05:22.061642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95283eb-262d-4c45-adf3-0725599fc0ea None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.061854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95283eb-262d-4c45-adf3-0725599fc0ea None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.062109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95283eb-262d-4c45-adf3-0725599fc0ea None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.063657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 489/983] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:22.068914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.069172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.069485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.086498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:22.087687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:22.157151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:22.168539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 495/984] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:22.186498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95283eb-262d-4c45-adf3-0725599fc0ea None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:22.290470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95283eb-262d-4c45-adf3-0725599fc0ea None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:22.325103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:22.325846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.326130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.326407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.327066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:22.328457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:22.340659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:22.341725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:22.342601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:22.344975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 490/985] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:22.347990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:22.450114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de2f5-7106-4730-8db1-e34cd5d63ffe None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:22.484289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:22.484986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.485273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.485544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.486264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:22.486568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:22.487963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:22.492978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 496/986] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:22.498640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:22.501608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:22.600046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8794-4043-4bc7-a10e-191a2f992ccf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:22.634385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:22.635056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.635345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.635623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.636419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:22.636762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:22.638153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:22.643612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 491/987] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:22.649384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:22.721866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:22.767295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47684a-75d4-43e1-a561-0a6da59596eb None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:22.813120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:22.813808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.814099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.814380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.815195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] RBAC: Adding query filter params (interface=admin, service_id=690bc38a7de349c19c2b612c14d534e8, region_id=RegionOne) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:22.815508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:22.816952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dc9e9-e78a-4e92-abc0-810078288ef0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:22.827022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 497/988] 10.222.0.46 () {56 vars in 1249 bytes} [Mon May 23 17:05:22 2022] GET /identity/v3/endpoints?service_id=690bc38a7de349c19c2b612c14d534e8&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:22.828187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:22.897413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:22.933918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f78e-ab83-417e-9f40-b513230602be None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:22.967391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ac7b6-6dbe-4029-a7c2-9e73f6e3b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:22.968068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac7b6-6dbe-4029-a7c2-9e73f6e3b554 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:22.968358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac7b6-6dbe-4029-a7c2-9e73f6e3b554 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:22.968651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac7b6-6dbe-4029-a7c2-9e73f6e3b554 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:22.969345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ac7b6-6dbe-4029-a7c2-9e73f6e3b554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:22.970745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ac7b6-6dbe-4029-a7c2-9e73f6e3b554 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:22.977789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 492/989] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:05:22 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:05:23.759874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d842-2a5e-4fad-b6c3-91e41bec452a None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:23.760422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d842-2a5e-4fad-b6c3-91e41bec452a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:23.760422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d842-2a5e-4fad-b6c3-91e41bec452a None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:23.761899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 498/990] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:23.767932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:23.768488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:23.768488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:23.787356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:23.788681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:23.808518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156058d2-88f6-46e9-b18f-6c20b442c743 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:23.808834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156058d2-88f6-46e9-b18f-6c20b442c743 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:23.809099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156058d2-88f6-46e9-b18f-6c20b442c743 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:23.810509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 499/991] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:23.817593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:23.817961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:23.818312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:23.835361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:23.836848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:23.860486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 493/992] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:23.882767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:23.908645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 500/993] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:23.930293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:23.941105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:23.982179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92da58-a88b-404c-b162-3491b8236a15 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:23.995869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:24.017951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.018778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.019121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.019345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] PATH_INFO: `/v3/services/image` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.020000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.021439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:24.033136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:24.034160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:24.035077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 494/994] 10.222.0.46 () {56 vars in 1105 bytes} [Mon May 23 17:05:23 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:24.040528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:24.044320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a87b4-ce96-412d-8157-956fbffaf146 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.084039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.085015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.085298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.085576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.086233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.087821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:24.100871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:24.101885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:24.102903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 501/995] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:24.108050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:24.149629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c865-535d-4f96-91ac-708aa800720d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.181186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:24.195547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.196225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.196845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.196845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.197497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] RBAC: Adding query filter params (name=image) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:24.197805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.199254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.209083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 495/996] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:24.209492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b067-d5ea-4b87-a2dd-083af4ebd025 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.209927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:24.232859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:24.245087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.245762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.246044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.246320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.247024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:24.247329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.248754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.253614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 502/997] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:24.259161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:24.320978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af387-2fd2-4036-a48c-68d8b3b2783b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.357069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.357743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.358029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.358307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.359009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] RBAC: Adding query filter params (type=image) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:24.359315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.359780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09e5e0-d370-44f2-93c1-2a7b315947d2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.360713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.365530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 496/998] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:24.402366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.403067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.403351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.403627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.404356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:24.404667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.406137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.412485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 503/999] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:24.418428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:24.479251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:24.533063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd4f9-3ace-4ab8-a93d-c1b16ff7475c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.569820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.570518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.570803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.571136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.571865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] RBAC: Adding query filter params (interface=public, service_id=8cb98e7cf7024defa68c51ed6c139923, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:24.572200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.573659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64493c0-ee5c-4ff2-8822-fe8725b82013 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.579332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 497/1000] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:05:24 2022] GET /identity/v3/endpoints?service_id=8cb98e7cf7024defa68c51ed6c139923&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:24.584974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:24.639740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:24.693584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76a0b-69fb-448c-8784-64fdf1c5235d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:24.730125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25fe5-4ec2-4a91-96a3-c3a995841286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:24.734644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25fe5-4ec2-4a91-96a3-c3a995841286 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:24.734982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25fe5-4ec2-4a91-96a3-c3a995841286 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:24.735272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25fe5-4ec2-4a91-96a3-c3a995841286 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:24.735996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25fe5-4ec2-4a91-96a3-c3a995841286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:24.737475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25fe5-4ec2-4a91-96a3-c3a995841286 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:24.745752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 504/1001] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:05:24 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:05:25.196192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111c1f3-49a5-40e8-a48f-c807bd2c764a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:25.196798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111c1f3-49a5-40e8-a48f-c807bd2c764a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:25.196798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111c1f3-49a5-40e8-a48f-c807bd2c764a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:25.198437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 498/1002] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:25.203986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:25.204403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:25.204626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:25.221778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:25.222994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:25.292648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 505/1003] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:25.316937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111c1f3-49a5-40e8-a48f-c807bd2c764a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:25.424307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111c1f3-49a5-40e8-a48f-c807bd2c764a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:25.440688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:25.460261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:25.461132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:25.461381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:25.461694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:25.462391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:25.463844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:25.477649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:25.478753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:25.485043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 499/1004] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 17:05:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:25.487541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:25.535782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:25.593196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17eb7-6456-4cce-aa7e-26218d44dc00 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:25.626857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:25.627529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:25.627818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:25.628100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:25.628833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:25.629147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:25.630611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:25.636482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 506/1005] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:25.642556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:25.745583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646faecd-4909-44d0-ac67-593ac6b2b0c7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:25.779489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:25.780270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:25.780555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:25.780861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:25.781613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:25.781923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:25.786178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578779-bbe1-4349-aa8a-e33f6648cadc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:25.792796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 500/1006] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 17:05:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:25.798570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:25.903189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a765-f1f3-450c-953b-51f0377b1c7e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:25.913666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:25.939424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c50f-ad9f-4578-841f-1182162f84d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:25.940087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c50f-ad9f-4578-841f-1182162f84d2 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:25.940370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c50f-ad9f-4578-841f-1182162f84d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:25.940736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c50f-ad9f-4578-841f-1182162f84d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:25.941485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4c50f-ad9f-4578-841f-1182162f84d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:25.942881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4c50f-ad9f-4578-841f-1182162f84d2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:25.964636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 507/1007] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:26.558734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cad58-38d1-44f7-859b-59ce16d662b6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:26.559342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cad58-38d1-44f7-859b-59ce16d662b6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:26.559342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cad58-38d1-44f7-859b-59ce16d662b6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:26.560978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 501/1008] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:26.566423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca68d-f4ce-4213-96ed-d178cf155e19 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:26.566854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca68d-f4ce-4213-96ed-d178cf155e19 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:26.567019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca68d-f4ce-4213-96ed-d178cf155e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:26.584626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f21ca68d-f4ce-4213-96ed-d178cf155e19 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:26.585866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f21ca68d-f4ce-4213-96ed-d178cf155e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:26.665688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 508/1009] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:26.688496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cad58-38d1-44f7-859b-59ce16d662b6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:26.764212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:26.846249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cad58-38d1-44f7-859b-59ce16d662b6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:26.882187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c74ce0-e9fb-4dcc-9d48-85598e995900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:26.882870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74ce0-e9fb-4dcc-9d48-85598e995900 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:26.883158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74ce0-e9fb-4dcc-9d48-85598e995900 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:26.883439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74ce0-e9fb-4dcc-9d48-85598e995900 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:26.884186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74ce0-e9fb-4dcc-9d48-85598e995900 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:26.885628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74ce0-e9fb-4dcc-9d48-85598e995900 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:26.906883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 502/1010] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:26 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:26.958368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df286-6b6e-4dd2-82f8-f7898b7665b9 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:26.959018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df286-6b6e-4dd2-82f8-f7898b7665b9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:26.959449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df286-6b6e-4dd2-82f8-f7898b7665b9 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:26.961292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 509/1011] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:26.968661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:26.968661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:26.968661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:26.987223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:26.988887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:27.076586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 503/1012] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:27.099902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df286-6b6e-4dd2-82f8-f7898b7665b9 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:27.200479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:27.209099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df286-6b6e-4dd2-82f8-f7898b7665b9 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:27.244211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:27.245144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:27.245436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:27.245711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:27.246358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:27.247747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:27.259580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:27.260567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:27.261960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 510/1013] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:27.267609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:27.298224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:27.373819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092ad81-b886-436d-8ad4-2fd41c72c587 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:27.408742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:27.409423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:27.409710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:27.410081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:27.410791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:27.411098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:27.412496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:27.417897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 504/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:27.423447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:27.525550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa23f3d-ff32-425e-a137-bde122635287 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:27.559637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:27.560307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:27.560589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:27.560935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:27.561664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:27.561970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:27.563367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1d1d3-436c-4259-8b01-dabc1d02f3d4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:27.572823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 511/1015] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 17:05:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:27.574898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:27.674186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:27.682477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0794358-bef3-4e04-aca9-ad01abc7629b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:27.716842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc61fcc-8e51-447a-9c65-fd5ceabc056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:27.717525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61fcc-8e51-447a-9c65-fd5ceabc056d None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:27.717812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61fcc-8e51-447a-9c65-fd5ceabc056d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:27.718091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61fcc-8e51-447a-9c65-fd5ceabc056d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:27.718838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61fcc-8e51-447a-9c65-fd5ceabc056d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:27.720236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61fcc-8e51-447a-9c65-fd5ceabc056d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:27.744626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 505/1016] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:05:28.196395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66552-9876-444e-b0b2-b4303d33096f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:28.196845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66552-9876-444e-b0b2-b4303d33096f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:28.197017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66552-9876-444e-b0b2-b4303d33096f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:28.198471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 512/1017] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:28.204297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:28.204565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:28.204914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:28.223454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:28.224725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:28.298433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 506/1018] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:28.321489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66552-9876-444e-b0b2-b4303d33096f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:28.347437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:28.429987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66552-9876-444e-b0b2-b4303d33096f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:28.472857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5403bf-58ec-49f9-a880-9a1e2bf96f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:28.473578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5403bf-58ec-49f9-a880-9a1e2bf96f33 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:28.475690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5403bf-58ec-49f9-a880-9a1e2bf96f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:28.475690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5403bf-58ec-49f9-a880-9a1e2bf96f33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:28.477390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5403bf-58ec-49f9-a880-9a1e2bf96f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:28.478124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5403bf-58ec-49f9-a880-9a1e2bf96f33 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:28.479987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 513/1019] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:28.485896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:28.563518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:28.589006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfed4e-8808-4c8e-a998-bb977af5de3c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:28.623190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efd42d-5ed8-4d9b-b7ee-35625b84ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:28.623861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efd42d-5ed8-4d9b-b7ee-35625b84ebdb None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:28.624143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efd42d-5ed8-4d9b-b7ee-35625b84ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:28.624418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efd42d-5ed8-4d9b-b7ee-35625b84ebdb None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:28.625172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efd42d-5ed8-4d9b-b7ee-35625b84ebdb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:28.626624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efd42d-5ed8-4d9b-b7ee-35625b84ebdb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:28.660629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 507/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:28 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:05:29.124908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1917-a8d8-40d2-ad65-fd1ed937480f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:29.125443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1917-a8d8-40d2-ad65-fd1ed937480f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:29.125443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1917-a8d8-40d2-ad65-fd1ed937480f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:29.126808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 514/1021] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:29.132204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:29.132506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:29.132834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:29.150119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:29.151309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:29.221176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 508/1022] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:29.242981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1917-a8d8-40d2-ad65-fd1ed937480f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:29.336379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:29.351009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1917-a8d8-40d2-ad65-fd1ed937480f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:29.384691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:29.385410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:29.385686 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:29.386081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] PATH_INFO: `/v3/services/image` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:29.386728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:29.388263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:29.400179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:29.401193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:29.402040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:29.404961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 515/1023] 10.222.0.46 () {56 vars in 1105 bytes} [Mon May 23 17:05:29 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:29.407446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:29.465223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:29.509570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400c86-2ae1-4fa2-b11b-da6a2c8ff165 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:29.544786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:29.545467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:29.545751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:29.546118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:29.546824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:29.547135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:29.548649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:29.558931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 509/1024] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:29.560562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:29.661017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec623b4-4ec5-45b8-b15e-91337605db3b None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:29.693828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:29.694497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:29.694770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:29.695026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:29.695746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] RBAC: Adding query filter params (type=image) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:29.696053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:29.697470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:29.702941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 516/1025] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:29.708614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:29.816746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59ace-49ed-4922-85d7-2ee1008e6eb2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:29.841514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:29.854913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:29.855606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:29.855888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:29.856164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:29.857008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] RBAC: Adding query filter params (interface=public, service_id=841fed99522147caae36fc6a26d8e618, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:29.857325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:29.858757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bf922-520d-4351-a225-947197bf8a59 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:29.865296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 510/1026] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:05:29 2022] GET /identity/v3/endpoints?service_id=841fed99522147caae36fc6a26d8e618&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:29.871134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:29.892493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:29.974943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fa5c6-4f0b-4c03-b7d0-b3f629a8d039 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:30.007726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe328996-eaeb-401f-bb97-c8bf698d79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:30.008403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe328996-eaeb-401f-bb97-c8bf698d79d4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.008714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe328996-eaeb-401f-bb97-c8bf698d79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.008987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe328996-eaeb-401f-bb97-c8bf698d79d4 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.009705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe328996-eaeb-401f-bb97-c8bf698d79d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:30.011122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe328996-eaeb-401f-bb97-c8bf698d79d4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:30.023528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 517/1027] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:05:29 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:05:30.041058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a476f-346c-4cf0-8d9b-07bbd2c30fc8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.041278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a476f-346c-4cf0-8d9b-07bbd2c30fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.041579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a476f-346c-4cf0-8d9b-07bbd2c30fc8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.043194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 511/1028] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:30.049427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.049725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.050012 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.067968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:30.069245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:30.146857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 518/1029] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:30.171615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a476f-346c-4cf0-8d9b-07bbd2c30fc8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:30.278351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a476f-346c-4cf0-8d9b-07bbd2c30fc8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:30.311956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:30.312813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.313096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.313373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.323567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:30.331724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:30.332909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:30.333756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 512/1030] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 17:05:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:30.340787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:30.356726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:30.449760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0bb3-ec4b-4bf3-bcb2-5c88360c91fa None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:30.485335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:30.486077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.486369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.486650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.487406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:30.487723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:30.489155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:30.502806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 519/1031] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:05:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:30.503839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:30.558037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:30.612566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7519-fc45-45c6-a2aa-cbc2fbad6619 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:30.647025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:30.647822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.648101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.648374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.658903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:30.660355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:30.677204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:30.678159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:30.679049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:30.679049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:30.679049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:30.679049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:30.679049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 513/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:30.685819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:30.771652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:30.808885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64320c19-fd25-4841-a639-9923aab1c3d5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:30.845601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:30.846288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.846576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.846855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.847589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:30.847901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:30.849329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd141a81-d0fa-4394-8d74-bfb477c96ac0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:30.866318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 520/1033] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:30.867671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:30.880436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724e87-c238-4a53-8079-87ff0c296c11 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.880781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724e87-c238-4a53-8079-87ff0c296c11 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.881068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724e87-c238-4a53-8079-87ff0c296c11 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.883277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 521/1034] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:30.888386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:30.888707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:30.889066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:30.905760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:30.906958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:30.971760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:30.975762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2121-1f86-45ee-9f08-a167d53a55f1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:30.981405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 522/1035] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:31.003209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.013902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.014686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.015327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.015603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.023543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.025128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:31.040225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:31.041374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:31.042448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 514/1036] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:05:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:31.049785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.077058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:31.118179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c3da4-f44a-4f76-9ef3-a9c632085289 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:31.153933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d48275-351b-4f79-a06c-73b451df1360 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:31.157349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.158194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.158477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.158752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.159924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.161624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.163257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 523/1037] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:31.169226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.189249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.189950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.190239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.190525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.191371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:31.191687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.193213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.210517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 515/1038] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:05:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:31.216169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.233472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:31.276123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840e2df-d050-45aa-97e8-bdb744375067 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:31.308321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:31.314226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.314908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.315193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.315468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.316173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.317670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.323164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1a623-6940-4fb3-8a5b-4e1e08c5f266 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:31.339476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 524/1039] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:05:31 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:31.370425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.371261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.371551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.371829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.448933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.450443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.470051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:31.568225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 516/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:05:31.575128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.679863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdedf0-48c7-4b16-9466-ba06bcefca46 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:31.715482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.716300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.716573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.716876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.727894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.729398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:31.748148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:31.749372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:31.754985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:31.754985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:31.754985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:31.754985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:31.754985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 525/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:31.756842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.879776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd64d-e048-4d4f-86d9-b17cd477f5b2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:31.897836 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:31.916642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:31.917337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:31.917631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:31.917916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:31.918655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:31.918978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:31.920401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:31.936550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 517/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:31.938211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:31.982548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:32.047483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd51c7-99e3-47ad-ab40-5a621d746309 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:32.085553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:32.086358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.086650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.086928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.093886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:32.095384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b450e005-d65d-4be4-97fc-e717f1ac4741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:32.110458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:32.111415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:32.112309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:32.116638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 526/1043] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:32.118048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:32.223025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b88f-c82c-420a-ba2b-0e6217c0819c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:32.233924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053778-ecda-47f6-b7ba-46294a72c80e None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.234429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053778-ecda-47f6-b7ba-46294a72c80e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.234521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053778-ecda-47f6-b7ba-46294a72c80e None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.236116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 527/1044] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:32.241711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.242383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.242670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.259230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:32.260122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.260270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:32.260438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.260798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.261373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:32.261627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:32.261943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:32.263376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:32.276106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 518/1045] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:32.281866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:32.319030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:32.331406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 528/1046] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:32.354087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:32.384558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfebd0-55b2-4492-bdab-eeb0cf2f0ade None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:32.384840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:32.421799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:32.422490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.422752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.423024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.423902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] RBAC: Adding query filter params (role.id=fac8c417a83045f3b95ff252705df98a, scope.project.id=444a244a713944db9caf259034ccd231, user.id=12c6f9c481ec4108a86db440cc90311f) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:32.424221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:32.425719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:32.431989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 519/1047] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:32 2022] GET /identity/v3/role_assignments?user.id=12c6f9c481ec4108a86db440cc90311f&scope.project.id=444a244a713944db9caf259034ccd231&role.id=fac8c417a83045f3b95ff252705df98a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:32.470977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb1f2b-0249-4cdd-b277-8f523ac6bdd2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:32.509450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:32.510186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.510471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.510786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] PATH_INFO: `/v3/services/image` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.511594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:32.513115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:32.526861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:32.527979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:32.534838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 529/1048] 10.222.0.46 () {56 vars in 1105 bytes} [Mon May 23 17:05:32 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:32.537210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:32.651013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:32.654189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63251a4d-8dec-4f60-8c2c-306b42ada40d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:32.690651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:32.691671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.692156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.692640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.693551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:32.694040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:32.695645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:32.706084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 520/1049] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:32.707678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:32.813202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:32.820966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d2345-f989-4c8c-a527-bbc2e8939176 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:32.855559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:32.856241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:32.856527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:32.856852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:32.857565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] RBAC: Adding query filter params (type=image) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:32.857931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:32.859397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45483fde-2b15-49c8-986b-61ecaf5ba121 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:32.864583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 530/1050] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:32.870419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:32.975975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6e996-3906-427b-9200-bbbae251feb3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:33.011156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836a8a6-8d7b-44da-aea3-42f22d9b50af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:33.011890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a8a6-8d7b-44da-aea3-42f22d9b50af None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:33.012183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a8a6-8d7b-44da-aea3-42f22d9b50af None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:33.012442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a8a6-8d7b-44da-aea3-42f22d9b50af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:33.013275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836a8a6-8d7b-44da-aea3-42f22d9b50af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:33.014691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836a8a6-8d7b-44da-aea3-42f22d9b50af None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:33.035756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 521/1051] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:05:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:33.627044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59be62-ae3e-4f53-ae90-056cdcbee8a1 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:33.627659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59be62-ae3e-4f53-ae90-056cdcbee8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:33.627659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59be62-ae3e-4f53-ae90-056cdcbee8a1 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:33.629222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 531/1052] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:33.634367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:33.634675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:33.634952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:33.652752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:33.653948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:33.674183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:33.732677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 522/1053] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:33.755942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59be62-ae3e-4f53-ae90-056cdcbee8a1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:33.869137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59be62-ae3e-4f53-ae90-056cdcbee8a1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:33.902182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:33.902904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:33.903185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:33.903459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:33.913878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:33.921534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:33.922481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:33.923320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 532/1054] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:33.928963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.027574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06bf86-68d8-4a4d-82e4-49b97b30fc13 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:34.061305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:34.061980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.062268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.062581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.063334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:34.063644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:34.065103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:34.074234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 523/1055] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:34.079984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.099583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:34.184734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45071b-dc5b-484e-9994-eb265075d418 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:34.220472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:34.221395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.221697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.221989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] PATH_INFO: `/v3/users/eb0c7dfbb875493d9d28cc9ea98742a3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.235885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=eb0c7dfbb875493d9d28cc9ea98742a3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:34.237376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:34.239251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 533/1056] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:34 2022] GET /identity/v3/users/eb0c7dfbb875493d9d28cc9ea98742a3 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:34.244903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.256377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:34.345409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55da60-4b60-4811-af05-1176906a1312 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:34.378295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac495d5-16a8-4f72-87fb-85dbbc30c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:34.378957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac495d5-16a8-4f72-87fb-85dbbc30c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.379243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac495d5-16a8-4f72-87fb-85dbbc30c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.379516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac495d5-16a8-4f72-87fb-85dbbc30c5a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.446787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac495d5-16a8-4f72-87fb-85dbbc30c5a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:34.448248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac495d5-16a8-4f72-87fb-85dbbc30c5a2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:34.459646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:34.552670 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 524/1057] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:34.555528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.632518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:34.633178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2c2a-0161-4994-b182-bcec3a1e27f8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.633178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2c2a-0161-4994-b182-bcec3a1e27f8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.633178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2c2a-0161-4994-b182-bcec3a1e27f8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.634188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 525/1058] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:34.640274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.640589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.640899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.657796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:34.658987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:34.664699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f34f-9958-433f-b946-009dca2daaf8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:34.702628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:34.703618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.703924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.704224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.705604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] RBAC: Authorizing `identity:get_project(project_id=07339928f88a4242b1aba7452de655b2)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:34.707309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:34.714457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 534/1059] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:05:34 2022] GET /identity/v3/projects/07339928f88a4242b1aba7452de655b2 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:34.715608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.733568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 526/1060] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:34.756226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.805881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:34.827976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014de2-4850-4d4d-bc86-9e7df317d53a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:34.865027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658307e-3766-422e-9c9d-ad3da6b729f2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:34.865234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:34.865866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.866146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.866650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.867619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=07339928f88a4242b1aba7452de655b2, user.id=eb0c7dfbb875493d9d28cc9ea98742a3) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:34.867937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:34.869441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:34.876147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 535/1061] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:34 2022] GET /identity/v3/role_assignments?user.id=eb0c7dfbb875493d9d28cc9ea98742a3&scope.project.id=07339928f88a4242b1aba7452de655b2&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:34.905647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:34.906520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:34.906803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:34.907078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:34.919653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:34.928326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:34.929635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:34.931012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 527/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 17:05:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:34.936680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:34.948202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.046982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc210e-c4f6-4147-afba-5d3df3b89eac None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.088140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.088958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.089398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.089678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.090469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:35.090785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.092252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f796f8f-8c0e-4a95-aca1-c4a543dbbe9c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.102158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 536/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:05:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:35.108529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.207286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.211928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b22087-05e7-4fc8-89f7-41792773f7ee None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.247948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.248805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.249088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.249363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.260354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.261954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.268805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308465-5d3c-4e57-9eda-1deb4b74db7b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.269116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308465-5d3c-4e57-9eda-1deb4b74db7b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.269397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308465-5d3c-4e57-9eda-1deb4b74db7b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.270924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 537/1064] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:05:35.275723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.276010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.276293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:35.279678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:35.280740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:35.281980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:35.281980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:35.281980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:35.281980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:35.285566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 528/1065] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:35.286274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.296360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:35.298044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:35.368735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.374703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 538/1066] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:35.393880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1ede-58fd-4756-878a-e70dad4e7a48 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.396629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.432220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.432976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.433258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.433534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.434264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:35.434575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.435968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.448640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 529/1067] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:35.453850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.465683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.501859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c5bb-b250-4fad-ab96-0b8ca14e15c3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.539708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.540724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.541217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.541667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.556424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddfcf4-d1e5-4486-8670-75f2cc38a75f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.592200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.593058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.593344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.593842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.601104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.602573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.612377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.615502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:35.617207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:35.618133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:35.619104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:35.619692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.623459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 530/1068] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:35.624328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.695106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.729219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a4d2-65fd-4899-a1b0-3859ee12e3b8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.733562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 539/1069] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:05:35.739542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.767285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.768010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.768295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.768618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.769476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:35.769792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.771245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.789773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 531/1070] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:35.795592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.850013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.853439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667187a-1487-40dd-96a6-b17a8f0b0775 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.891361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.892254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.892563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.892889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.897180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8128de-8980-438d-b6a3-003db21971af None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:35.903144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.904992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:35.924105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:35.925075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:35.925988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:35.925988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:35.925988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:35.925988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:35.925988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 540/1071] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:35.927496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:35.931405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:35.936016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106640-14a6-4913-9712-239748294a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:35.936891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106640-14a6-4913-9712-239748294a29 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:35.937177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106640-14a6-4913-9712-239748294a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:35.937451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106640-14a6-4913-9712-239748294a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:35.948022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106640-14a6-4913-9712-239748294a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:35.949556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106640-14a6-4913-9712-239748294a29 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-bb106640-14a6-4913-9712-239748294a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:35.967350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:35.968647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:35.969854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:35.969854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:35.969854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:35.969854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:35.973493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 532/1072] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:35.974500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106640-14a6-4913-9712-239748294a29 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:36.048727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c9b11-0e58-48f7-9c26-12d0265baf28 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:36.079823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106640-14a6-4913-9712-239748294a29 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:36.084188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:36.084897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:36.085185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:36.085468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:36.086190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:36.086499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:36.087898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:36.100246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 541/1073] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:36.116488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:36.117970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:36.118452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:36.118913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:36.119848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:36.120390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:36.122040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:36.135805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 533/1074] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:36.142266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:36.158829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:36.254569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7062c-bf28-4129-a857-c734764b0f38 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:36.291630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:36.292524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:36.293831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:36.293831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:36.300515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:36.302024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:36.316085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:36.317314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:36.318568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 542/1075] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:36.324349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:36.370123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:36.429745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660232f-6037-41ca-a81f-6a48826689af None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:36.465758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:36.466443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:36.466722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:36.466998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:36.467786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:36.468134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:36.469620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec464c-f13f-47c2-aa75-6752c2221140 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:36.484868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 534/1076] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:36.491023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:36.563532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:36.595319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602246a-767a-4cd1-9d9a-a585ac6f1234 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:36.631456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef807a-0856-4ba2-a590-a86d081f651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:36.632404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef807a-0856-4ba2-a590-a86d081f651c None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:36.632724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef807a-0856-4ba2-a590-a86d081f651c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:36.633005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef807a-0856-4ba2-a590-a86d081f651c None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/12c6f9c481ec4108a86db440cc90311f/roles/fac8c417a83045f3b95ff252705df98a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:36.635570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef807a-0856-4ba2-a590-a86d081f651c None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=12c6f9c481ec4108a86db440cc90311f, role_id=fac8c417a83045f3b95ff252705df98a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:36.637097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef807a-0856-4ba2-a590-a86d081f651c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:36.651817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 543/1077] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:05:36 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/12c6f9c481ec4108a86db440cc90311f/roles/fac8c417a83045f3b95ff252705df98a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:37.087778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56466d9b-33dc-4c9e-aa7c-eddca43e8b0a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.088173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56466d9b-33dc-4c9e-aa7c-eddca43e8b0a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.088456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56466d9b-33dc-4c9e-aa7c-eddca43e8b0a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.089931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 535/1078] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:37.095585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.096073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.096171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.113468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:37.114668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:37.183168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 544/1079] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:37.205408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56466d9b-33dc-4c9e-aa7c-eddca43e8b0a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:37.306503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:37.311006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56466d9b-33dc-4c9e-aa7c-eddca43e8b0a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:37.344260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:37.345055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.345349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.345606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.355789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:37.363392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:37.364372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:37.365303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 536/1080] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:37.370866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:37.434213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:37.473310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7491a1-1a65-45c2-ac7e-e23993f9b191 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:37.508140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:37.508843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.509121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.509394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.510143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:37.510446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:37.511878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:37.520338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 545/1081] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:37.526498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:37.625606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffd03a-1155-48d2-b2d1-ec1bc618e476 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:37.659354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:37.660235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.660519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.660819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] PATH_INFO: `/v3/users/eb0c7dfbb875493d9d28cc9ea98742a3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.662016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] RBAC: Authorizing `identity:get_user(user_id=eb0c7dfbb875493d9d28cc9ea98742a3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:37.663460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:37.665132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 537/1082] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:37 2022] GET /identity/v3/users/eb0c7dfbb875493d9d28cc9ea98742a3 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:37.671030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:37.774145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed846552-0c98-44ea-9f7c-c4ea7b83dab2 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:37.802673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:37.814743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94018e0c-7fbb-47fb-b614-7a2a74e719ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:37.815634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94018e0c-7fbb-47fb-b614-7a2a74e719ff None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.815916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94018e0c-7fbb-47fb-b614-7a2a74e719ff None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.816195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94018e0c-7fbb-47fb-b614-7a2a74e719ff None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.817432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94018e0c-7fbb-47fb-b614-7a2a74e719ff None admin] RBAC: Authorizing `identity:get_project(project_id=07339928f88a4242b1aba7452de655b2)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:37.818896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94018e0c-7fbb-47fb-b614-7a2a74e719ff None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:37.820634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 546/1083] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:05:37 2022] GET /identity/v3/projects/07339928f88a4242b1aba7452de655b2 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:37.826969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:37.857533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:37.930235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fff1d-fa1c-4b9f-91bc-526ad04f1523 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:37.963666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8b3f7-f42a-4950-a334-c0ee82aedc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:37.964630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8b3f7-f42a-4950-a334-c0ee82aedc3d None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:37.964917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8b3f7-f42a-4950-a334-c0ee82aedc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:37.965192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8b3f7-f42a-4950-a334-c0ee82aedc3d None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2/users/eb0c7dfbb875493d9d28cc9ea98742a3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:37.967216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8b3f7-f42a-4950-a334-c0ee82aedc3d None admin] RBAC: Authorizing `identity:create_grant(project_id=07339928f88a4242b1aba7452de655b2, user_id=eb0c7dfbb875493d9d28cc9ea98742a3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:37.968662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8b3f7-f42a-4950-a334-c0ee82aedc3d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:37.983374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 538/1084] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:05:37 2022] PUT /identity/v3/projects/07339928f88a4242b1aba7452de655b2/users/eb0c7dfbb875493d9d28cc9ea98742a3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:38.797639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda492c9-eded-499f-8045-9fabe71d605f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:38.798210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda492c9-eded-499f-8045-9fabe71d605f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:38.798210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda492c9-eded-499f-8045-9fabe71d605f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:38.799581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 547/1085] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:38.804866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:38.805384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:38.805384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:38.823196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:38.824378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:38.891202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 539/1086] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:38.914499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda492c9-eded-499f-8045-9fabe71d605f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:39.019743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda492c9-eded-499f-8045-9fabe71d605f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:39.053678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:39.054429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:39.054709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:39.054982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:39.068117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:39.076504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:39.077698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:39.078561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 548/1087] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 17:05:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:39.083908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:39.102322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:39.185264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff6a4d-5726-4090-937d-a9d04ec40ec8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:39.219984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:39.220707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:39.220988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:39.221272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:39.222024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:39.222397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:39.223877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:39.232149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 540/1088] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:05:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:39.238000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:39.291824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:39.339835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2e17-830a-4904-a44d-07eee19cdc4c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:39.374572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:39.375412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:39.375701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:39.375972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:39.387319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:39.388839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:39.407436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:39.408437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:39.409745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:39.409745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:39.409745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:39.409745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:39.409745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 549/1089] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:39.414548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:39.498308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:39.520264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc82ab-7ab6-4b8b-a660-2b0377dc470d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:39.555074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:39.555868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:39.556227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:39.556586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:39.557352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:39.557707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:39.559140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:39.571429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 541/1090] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:39.577199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:39.680630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce25b7-293d-491c-98a2-809d4c9609bf None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:39.683066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:39.716407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:39.717233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:39.717517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:39.717787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:39.725899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:39.727411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:05:39.741423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:39.742496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:39.743990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 550/1091] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 17:05:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:39.748508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:39.850972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f3b71-dad2-49b1-9bdb-3ba75a36927a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:39.893962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:39.894813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:39.895101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:39.895386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:39.896234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:39.896550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:39.898036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7de22-7b20-4c07-9b11-860d096ef949 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:39.907077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:39.921110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 542/1092] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 17:05:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:39.922400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.040900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6b47-c615-40e0-87f4-d23872e63504 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.075473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.076127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.076412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.076716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.107754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.146570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.148089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.149445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f92fb-38f5-42b0-9df3-0b86d2fd2120 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.149738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f92fb-38f5-42b0-9df3-0b86d2fd2120 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.150016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f92fb-38f5-42b0-9df3-0b86d2fd2120 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.151554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 543/1093] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:40.156548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2126-d755-434c-b02d-27500be233af None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.156873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2126-d755-434c-b02d-27500be233af None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.157152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2126-d755-434c-b02d-27500be233af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.174523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-662b2126-d755-434c-b02d-27500be233af None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:40.175760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-662b2126-d755-434c-b02d-27500be233af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:40.242263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 544/1094] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:40.252174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 551/1095] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:40.253578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2126-d755-434c-b02d-27500be233af None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.265603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.328544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.357112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2126-d755-434c-b02d-27500be233af None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.369771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e0383-8f26-48a0-9cd2-0a5ca50ed802 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.384957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.393525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.394340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.394629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.394910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.403535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.404356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.404662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.404943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.405061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.406529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.414901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:05:40.422640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:40.423702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:05:40.424890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 552/1096] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:05:40.430878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:40.431859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:40.432929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:05:40.432929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:05:40.432929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:05:40.432929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:40.432929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 545/1097] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:05:40.433214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.433292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.530726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05ff0-23d1-4165-83f0-04b9c3becd2d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.532881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802d151-f945-4855-b527-fc74d71f889b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.553604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.564508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.565224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.565510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.565790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.566584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:40.566893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.568290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.570247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.570928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.571218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.571501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.572208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:40.572539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.573978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.576639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 553/1098] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:40.582524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.585624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 546/1099] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:40.591672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.634909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.685378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444ffa-607c-4c1f-8cae-7420b0f85e38 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.695934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bead092-f2b9-410a-9c55-777c90bc141e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.718121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.719030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.719314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.719575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] PATH_INFO: `/v3/users/eb0c7dfbb875493d9d28cc9ea98742a3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.720808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] RBAC: Authorizing `identity:get_user(user_id=eb0c7dfbb875493d9d28cc9ea98742a3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.722313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.724011 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 554/1100] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/users/eb0c7dfbb875493d9d28cc9ea98742a3 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:40.729822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.730304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.731121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.731405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.731681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.738804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.740282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:05:40.755066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:05:40.756121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:05:40.757200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 547/1101] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:05:40.762236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.786662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.831318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864905c5-8183-41e2-8ad7-acf4db5b7763 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.863960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:40.865360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.866049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.866305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.866582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.867582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875fdc-b54e-4ca7-8d92-e7269ff2a1b8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:40.907160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:40.907803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:40.908140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:40.908415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:40.909235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:40.909542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.911035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.922333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 548/1102] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:40.928589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:40.938593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:40.940106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:40.995449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:41.028260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfa982-9387-4249-b65a-d80f952a3841 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:41.039548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 555/1103] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:41.045501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:41.062207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:41.062879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:41.063167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:41.063451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:41.064292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] RBAC: Adding query filter params (role.id=fac8c417a83045f3b95ff252705df98a, scope.project.id=444a244a713944db9caf259034ccd231, user.id=12c6f9c481ec4108a86db440cc90311f) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:41.064627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:41.066094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:41.072050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 549/1104] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:40 2022] GET /identity/v3/role_assignments?user.id=12c6f9c481ec4108a86db440cc90311f&scope.project.id=444a244a713944db9caf259034ccd231&role.id=fac8c417a83045f3b95ff252705df98a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:41.148773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d10e-a21f-464d-90fc-5c2a7ca12be5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:41.186388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2f07-6455-4359-aff5-9134d597e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:41.187280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2f07-6455-4359-aff5-9134d597e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:41.187562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2f07-6455-4359-aff5-9134d597e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:41.187837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2f07-6455-4359-aff5-9134d597e0c0 None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:41.189135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2f07-6455-4359-aff5-9134d597e0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=07339928f88a4242b1aba7452de655b2)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:41.190614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2f07-6455-4359-aff5-9134d597e0c0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:41.192368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 556/1105] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:05:41 2022] GET /identity/v3/projects/07339928f88a4242b1aba7452de655b2 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:41.198816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:41.226970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:41.314574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9292d-2b97-47ee-bb54-f97c5152b66f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:41.349471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:41.350137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:41.350431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:41.350706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:41.351539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=07339928f88a4242b1aba7452de655b2, user.id=eb0c7dfbb875493d9d28cc9ea98742a3) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:41.351854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:41.353342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bababfc2-d457-4364-9da9-032193728d34 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:41.360303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 550/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:41 2022] GET /identity/v3/role_assignments?user.id=eb0c7dfbb875493d9d28cc9ea98742a3&scope.project.id=07339928f88a4242b1aba7452de655b2&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:43.558511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab564f0d-6480-4db4-b74b-bb9e5c8c00aa None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:43.559155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab564f0d-6480-4db4-b74b-bb9e5c8c00aa None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:43.559155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab564f0d-6480-4db4-b74b-bb9e5c8c00aa None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:43.560425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 557/1107] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:43.566633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:43.567288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:43.567555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:43.587148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:43.588346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:43.659439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 551/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:43.686943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab564f0d-6480-4db4-b74b-bb9e5c8c00aa None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:43.713304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:43.788439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab564f0d-6480-4db4-b74b-bb9e5c8c00aa None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:43.823309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f2f4-3b1e-4d47-8723-ca5ce2d7a14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:43.824008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f2f4-3b1e-4d47-8723-ca5ce2d7a14f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:43.824281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f2f4-3b1e-4d47-8723-ca5ce2d7a14f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:43.824555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f2f4-3b1e-4d47-8723-ca5ce2d7a14f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:43.825833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f2f4-3b1e-4d47-8723-ca5ce2d7a14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:43.827295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f2f4-3b1e-4d47-8723-ca5ce2d7a14f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:43.828943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 558/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:43.834994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:43.855531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:43.939844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d58f5-d662-45ff-8621-d8e1edca3746 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:43.975521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4392-7a30-4478-acbf-a2a1bb88a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:43.976187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4392-7a30-4478-acbf-a2a1bb88a750 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:43.976472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4392-7a30-4478-acbf-a2a1bb88a750 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:43.976778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4392-7a30-4478-acbf-a2a1bb88a750 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:43.977497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc4392-7a30-4478-acbf-a2a1bb88a750 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:43.978950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc4392-7a30-4478-acbf-a2a1bb88a750 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:44.001466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 552/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:05:43 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:46.218472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70916a0-445e-4ed1-8fee-c581d71592ca None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:46.219321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70916a0-445e-4ed1-8fee-c581d71592ca None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:46.219459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70916a0-445e-4ed1-8fee-c581d71592ca None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:46.221943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 559/1111] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:46.228430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:46.228874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:46.229133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:46.253364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:46.254653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:46.337095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 553/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:46.360982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70916a0-445e-4ed1-8fee-c581d71592ca None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:46.462824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:46.474072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70916a0-445e-4ed1-8fee-c581d71592ca None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:46.509043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:46.509889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:46.510177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:46.510479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] PATH_INFO: `/v3/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:46.511996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] RBAC: Authorizing `identity:get_role(role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:46.513426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:46.515108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 560/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:46 2022] GET /identity/v3/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:46.523774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:46.527067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:46.637582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9ca55-e5ce-42ca-ae60-f58e4fb1c56e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:46.672315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:46.673231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:46.673510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:46.673782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] PATH_INFO: `/v3/users/7e8e659b5e194448ae9b778989c90562` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:46.687539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] RBAC: Authorizing `identity:get_user(user_id=7e8e659b5e194448ae9b778989c90562)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:46.689031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:46.690702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 554/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:46 2022] GET /identity/v3/users/7e8e659b5e194448ae9b778989c90562 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:46.696981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:46.798505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a295b-d52f-44ac-9b5e-11387ebfbae1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:46.832804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:46.833447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:46.833729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:46.833996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:46.861141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:46.908121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:46.909638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:47.022549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 561/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:47.030171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:47.095035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:47.137671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abada2-bc7a-4b73-aaf9-87fda7ac6562 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:47.175232 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58e30-a19d-4876-a50a-ca54e4f49b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:47.176097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58e30-a19d-4876-a50a-ca54e4f49b70 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:47.176382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58e30-a19d-4876-a50a-ca54e4f49b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:47.176645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58e30-a19d-4876-a50a-ca54e4f49b70 None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:47.177983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba58e30-a19d-4876-a50a-ca54e4f49b70 None admin] RBAC: Authorizing `identity:get_project(project_id=07339928f88a4242b1aba7452de655b2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:47.179445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba58e30-a19d-4876-a50a-ca54e4f49b70 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:47.181184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 555/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:05:47 2022] GET /identity/v3/projects/07339928f88a4242b1aba7452de655b2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:05:47.191157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:47.259185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:47.300316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd8b0-1b12-4b49-88e8-f9a5276ac7b8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:47.334429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:47.335075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:47.335359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:47.335634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:47.336468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] RBAC: Adding query filter params (role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=07339928f88a4242b1aba7452de655b2, user.id=7e8e659b5e194448ae9b778989c90562) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:47.336811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:47.338263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec7aaf-95b9-4ff6-9103-84e33a942aca None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:47.344418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 562/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:47 2022] GET /identity/v3/role_assignments?user.id=7e8e659b5e194448ae9b778989c90562&scope.project.id=07339928f88a4242b1aba7452de655b2&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:49.474319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8610dd-afda-46a4-a6eb-75d5e48ae620 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:49.475172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8610dd-afda-46a4-a6eb-75d5e48ae620 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:49.475172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8610dd-afda-46a4-a6eb-75d5e48ae620 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:49.477450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 556/1118] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:49.486253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:49.486673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:49.486877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:49.506961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:49.508158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:49.578051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 563/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:49.602820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8610dd-afda-46a4-a6eb-75d5e48ae620 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:49.732070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8610dd-afda-46a4-a6eb-75d5e48ae620 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:49.760923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:49.768277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:49.769171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:49.769457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:49.769739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] PATH_INFO: `/v3/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:49.771264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] RBAC: Authorizing `identity:get_role(role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:49.772661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:49.774032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 557/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:49 2022] GET /identity/v3/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:49.780171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:49.835669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:49.883158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9fac-a68b-4662-9055-9a90e5381827 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:49.918464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:49.919336 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:49.919623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:49.919894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] PATH_INFO: `/v3/users/7e8e659b5e194448ae9b778989c90562` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:49.921221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7e8e659b5e194448ae9b778989c90562)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:49.922687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:49.924305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 564/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:49 2022] GET /identity/v3/users/7e8e659b5e194448ae9b778989c90562 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:49.933789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:50.039908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391b60-e8f0-4066-a328-e05c45871fda None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:50.074322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaec786-0e60-4d0c-8841-36c206848b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:50.075189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaec786-0e60-4d0c-8841-36c206848b13 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:50.075472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaec786-0e60-4d0c-8841-36c206848b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:50.075750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaec786-0e60-4d0c-8841-36c206848b13 None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:50.076971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaec786-0e60-4d0c-8841-36c206848b13 None admin] RBAC: Authorizing `identity:get_project(project_id=07339928f88a4242b1aba7452de655b2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:50.078418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaec786-0e60-4d0c-8841-36c206848b13 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:50.080112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 558/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:05:49 2022] GET /identity/v3/projects/07339928f88a4242b1aba7452de655b2 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:50.086534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:50.194706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751bfc-94e3-4720-b2b4-24f2e26c58f0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:50.216667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:50.232779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c96ee-76a2-4fb1-a43b-35564ca70173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:50.233669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c96ee-76a2-4fb1-a43b-35564ca70173 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:50.233956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c96ee-76a2-4fb1-a43b-35564ca70173 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:50.234237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c96ee-76a2-4fb1-a43b-35564ca70173 None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2/users/7e8e659b5e194448ae9b778989c90562/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:50.236845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c96ee-76a2-4fb1-a43b-35564ca70173 None admin] RBAC: Authorizing `identity:create_grant(project_id=07339928f88a4242b1aba7452de655b2, user_id=7e8e659b5e194448ae9b778989c90562, role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:50.238303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c96ee-76a2-4fb1-a43b-35564ca70173 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:50.252287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 565/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:05:50 2022] PUT /identity/v3/projects/07339928f88a4242b1aba7452de655b2/users/7e8e659b5e194448ae9b778989c90562/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:05:52.395733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd0ea-c3a7-4b9f-91ed-423bf550e7a6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:52.396663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd0ea-c3a7-4b9f-91ed-423bf550e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:52.396663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd0ea-c3a7-4b9f-91ed-423bf550e7a6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:52.398831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 559/1124] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:52.405447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:52.405879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:52.406072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:52.426887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:52.428076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:52.503472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 566/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:05:52.527688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd0ea-c3a7-4b9f-91ed-423bf550e7a6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:52.600662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:52.652543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd0ea-c3a7-4b9f-91ed-423bf550e7a6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:52.688867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:52.689738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:52.690019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:52.690294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] PATH_INFO: `/v3/roles/9e1aa051e8de4c51981b05f594b150a5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:52.691905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] RBAC: Authorizing `identity:get_role(role_id=9e1aa051e8de4c51981b05f594b150a5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:52.693338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:52.694731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 560/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:52 2022] GET /identity/v3/roles/9e1aa051e8de4c51981b05f594b150a5 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:52.701508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:52.823309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013511f-ec95-426a-8e2f-2bf530bf97ff None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:52.835090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:52.861969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:52.862845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:52.863119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:52.863389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] PATH_INFO: `/v3/users/7e8e659b5e194448ae9b778989c90562` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:52.864646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] RBAC: Authorizing `identity:get_user(user_id=7e8e659b5e194448ae9b778989c90562)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:52.866141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:52.867786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 567/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:05:52 2022] GET /identity/v3/users/7e8e659b5e194448ae9b778989c90562 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:52.873882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:52.984543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1e83f-9954-4738-bfe1-be6ab09c095e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:53.027754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:53.028411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:53.028725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:53.029005 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:53.032039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:53.103892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:53.105421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:53.211359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 561/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:05:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:05:53.217921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:53.335411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feeead-1281-4817-aff6-f5037f6ef402 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:53.370710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f4277-64a9-4b2e-ba71-bc64eeb5592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:53.371570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f4277-64a9-4b2e-ba71-bc64eeb5592f None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:53.371850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f4277-64a9-4b2e-ba71-bc64eeb5592f None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:53.372123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f4277-64a9-4b2e-ba71-bc64eeb5592f None admin] PATH_INFO: `/v3/projects/07339928f88a4242b1aba7452de655b2` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:53.373438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f4277-64a9-4b2e-ba71-bc64eeb5592f None admin] RBAC: Authorizing `identity:get_project(project_id=07339928f88a4242b1aba7452de655b2)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:53.374849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f4277-64a9-4b2e-ba71-bc64eeb5592f None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:53.376537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 568/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:05:53 2022] GET /identity/v3/projects/07339928f88a4242b1aba7452de655b2 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:53.386321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:53.425352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:53.496023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f45527-645c-46e7-9e8f-61a442e5eb3a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:53.530975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:53.531660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:53.531954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:53.532223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:53.533064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] RBAC: Adding query filter params (role.id=9e1aa051e8de4c51981b05f594b150a5, scope.project.id=07339928f88a4242b1aba7452de655b2, user.id=7e8e659b5e194448ae9b778989c90562) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:05:53.533377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:53.534853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d01c-94e3-4cc9-818b-4dfcd71ad37a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:53.541317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 562/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:05:53 2022] GET /identity/v3/role_assignments?user.id=7e8e659b5e194448ae9b778989c90562&scope.project.id=07339928f88a4242b1aba7452de655b2&role.id=9e1aa051e8de4c51981b05f594b150a5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:55.741293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e85b31-068d-4615-a298-535b5ec41069 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:55.742168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e85b31-068d-4615-a298-535b5ec41069 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:55.742168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e85b31-068d-4615-a298-535b5ec41069 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:55.744391 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 569/1131] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:55.749883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:55.750323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:55.750416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:55.769107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:55.770286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:55.855237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 563/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:55.878905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e85b31-068d-4615-a298-535b5ec41069 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:55.934897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:55.990075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e85b31-068d-4615-a298-535b5ec41069 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:56.032198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c927a5-0829-4956-b69a-5be15939f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:56.032965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c927a5-0829-4956-b69a-5be15939f004 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:56.033251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c927a5-0829-4956-b69a-5be15939f004 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:56.033526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c927a5-0829-4956-b69a-5be15939f004 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:56.034753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c927a5-0829-4956-b69a-5be15939f004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:56.036243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c927a5-0829-4956-b69a-5be15939f004 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:56.037882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 570/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:56.043919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:56.072304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:56.160622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6d038-445f-4408-ae68-0075dfc72d67 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:56.195752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7687a1-95fc-4849-ac8a-af79de4eb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:56.196421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7687a1-95fc-4849-ac8a-af79de4eb4d7 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:56.196735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7687a1-95fc-4849-ac8a-af79de4eb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:56.197014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7687a1-95fc-4849-ac8a-af79de4eb4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:56.197742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7687a1-95fc-4849-ac8a-af79de4eb4d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:56.199181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7687a1-95fc-4849-ac8a-af79de4eb4d7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:56.230502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 564/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:05:56 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:05:58.408444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba1cf3-7e87-49a6-8b20-b6c100f15aa1 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:58.409298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba1cf3-7e87-49a6-8b20-b6c100f15aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:58.409298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba1cf3-7e87-49a6-8b20-b6c100f15aa1 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:58.411549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 571/1135] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:05:58.417229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:58.417649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:58.417774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:58.436339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:05:58.437553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:05:58.513827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 565/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:05:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:05:58.538924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba1cf3-7e87-49a6-8b20-b6c100f15aa1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:58.656477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba1cf3-7e87-49a6-8b20-b6c100f15aa1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:58.670618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:58.701975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bad4c-ed3a-4cbb-a33c-d18471102f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:58.702798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bad4c-ed3a-4cbb-a33c-d18471102f89 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:58.703080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bad4c-ed3a-4cbb-a33c-d18471102f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:58.703355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bad4c-ed3a-4cbb-a33c-d18471102f89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:58.704568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bad4c-ed3a-4cbb-a33c-d18471102f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:58.706057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bad4c-ed3a-4cbb-a33c-d18471102f89 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:58.707729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 572/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:05:58.713733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:05:58.725722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:05:58.815797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac302e-5bb6-4dd8-ac4f-3e683e413197 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:05:58.848484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1925de-a7c6-40c5-b349-77fb2e6bb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:05:58.849185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1925de-a7c6-40c5-b349-77fb2e6bb0ca None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:05:58.849465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1925de-a7c6-40c5-b349-77fb2e6bb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:05:58.849738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1925de-a7c6-40c5-b349-77fb2e6bb0ca None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:05:58.850448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1925de-a7c6-40c5-b349-77fb2e6bb0ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:05:58.851994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1925de-a7c6-40c5-b349-77fb2e6bb0ca None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:05:58.878936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 566/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:05:58 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:06:01.069696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07eaf-2884-4b90-88ad-5a1f0ec67162 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:01.070250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07eaf-2884-4b90-88ad-5a1f0ec67162 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:01.070250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07eaf-2884-4b90-88ad-5a1f0ec67162 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:01.071532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 573/1139] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:01.077287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:01.077710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:01.077798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:01.096358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:01.097562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:01.161777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:01.173296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 567/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:01.198041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c07eaf-2884-4b90-88ad-5a1f0ec67162 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:01.317962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c07eaf-2884-4b90-88ad-5a1f0ec67162 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:01.353412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:01.354149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:01.354435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:01.354712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:01.365752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:06:01.373461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:01.374520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:06:01.375555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 574/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:06:01.381535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:01.489363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0953-4592-4b2c-9a06-e75b207349d7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:01.523959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:01.524641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:01.524937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:01.525215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:01.525961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:01.526270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:01.527738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:01.535636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 568/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:01.541380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:01.594689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:01.663456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa094ac-8aa8-4727-b491-c384f5330483 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:01.706520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:01.707402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:01.707691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:01.707972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] PATH_INFO: `/v3/users/3dabdec46da04d8cb60b4c40a8a5d506` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:01.722494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] RBAC: Authorizing `identity:get_user(user_id=3dabdec46da04d8cb60b4c40a8a5d506)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:01.723991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:01.725811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 575/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:06:01 2022] GET /identity/v3/users/3dabdec46da04d8cb60b4c40a8a5d506 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:01.732674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:01.805931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:01.848371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d7a3a-a78f-4aff-9caa-4aab21fbb334 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:01.883720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:01.884371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:01.884693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:01.884966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:01.954752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:01.956158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:02.015985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:02.061999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 569/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:06:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:06:02.071448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:02.178380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:02.181808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4280-dfbb-460e-85f1-3eb0b9d646fa None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:02.223590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54af5d-11f9-4ba7-82d2-2702e5cc35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:02.224945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54af5d-11f9-4ba7-82d2-2702e5cc35e3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:02.225253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54af5d-11f9-4ba7-82d2-2702e5cc35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:02.225597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54af5d-11f9-4ba7-82d2-2702e5cc35e3 None admin] PATH_INFO: `/v3/projects/a23db5e059764d5ea9b02a5fff297a99` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:02.227642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54af5d-11f9-4ba7-82d2-2702e5cc35e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a23db5e059764d5ea9b02a5fff297a99)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:02.229981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54af5d-11f9-4ba7-82d2-2702e5cc35e3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:02.232560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 576/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:06:02 2022] GET /identity/v3/projects/a23db5e059764d5ea9b02a5fff297a99 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:02.242651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:02.346301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852ed9a-d066-4fd2-a378-470c2997b9fa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:02.381273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:02.381919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:02.382201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:02.382472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:02.383295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=a23db5e059764d5ea9b02a5fff297a99, user.id=3dabdec46da04d8cb60b4c40a8a5d506) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:02.383606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:02.385084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d907b-d130-423d-a3cd-85670d8eed70 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:02.391163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 570/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:06:02 2022] GET /identity/v3/role_assignments?user.id=3dabdec46da04d8cb60b4c40a8a5d506&scope.project.id=a23db5e059764d5ea9b02a5fff297a99&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:04.539690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85a8c-7f52-4f08-aeaf-4e0426afbf8e None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:04.540286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85a8c-7f52-4f08-aeaf-4e0426afbf8e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:04.540286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85a8c-7f52-4f08-aeaf-4e0426afbf8e None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:04.541674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 577/1147] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:04.548467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:04.549274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:04.549408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:04.576145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:04.577402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:04.594026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:04.645418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 571/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:04.667917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85a8c-7f52-4f08-aeaf-4e0426afbf8e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:04.775116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85a8c-7f52-4f08-aeaf-4e0426afbf8e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:04.810443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:04.811248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:04.811524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:04.811805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:04.822271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:06:04.829986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:04.831122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:06:04.832387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 578/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:06:04.837336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:04.941188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c19f-c9e2-494a-a2b3-c6dd5b4fd9a1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:04.978949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:04.979617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:04.979900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:04.980175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:04.980956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:04.981267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:04.982713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:04.992126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 572/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:04.998296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:05.028094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:05.107159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ec81-608d-4f29-8cba-acedff28569d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:05.154386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:05.155267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:05.155549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:05.155825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] PATH_INFO: `/v3/users/3dabdec46da04d8cb60b4c40a8a5d506` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:05.157171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] RBAC: Authorizing `identity:get_user(user_id=3dabdec46da04d8cb60b4c40a8a5d506)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:05.158648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:05.160285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 579/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:06:04 2022] GET /identity/v3/users/3dabdec46da04d8cb60b4c40a8a5d506 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:05.168815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:05.186044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:05.284832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39f19-c566-4863-8897-404a9657f928 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:05.318847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8b06-e9ac-4ff1-97d7-53bd0cdb1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:05.319712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8b06-e9ac-4ff1-97d7-53bd0cdb1287 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:05.319999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8b06-e9ac-4ff1-97d7-53bd0cdb1287 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:05.320272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8b06-e9ac-4ff1-97d7-53bd0cdb1287 None admin] PATH_INFO: `/v3/projects/a23db5e059764d5ea9b02a5fff297a99` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:05.321515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d8b06-e9ac-4ff1-97d7-53bd0cdb1287 None admin] RBAC: Authorizing `identity:get_project(project_id=a23db5e059764d5ea9b02a5fff297a99)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:05.322973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d8b06-e9ac-4ff1-97d7-53bd0cdb1287 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:05.324657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 573/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:06:05 2022] GET /identity/v3/projects/a23db5e059764d5ea9b02a5fff297a99 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:05.330980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:05.424695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:05.431920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b38c-5933-47ea-8f50-f26e6e8a61b7 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:05.470221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6f4d-30a8-4161-a113-776dec8cb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:05.471115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6f4d-30a8-4161-a113-776dec8cb4f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:05.471397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6f4d-30a8-4161-a113-776dec8cb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:05.471675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6f4d-30a8-4161-a113-776dec8cb4f6 None admin] PATH_INFO: `/v3/projects/a23db5e059764d5ea9b02a5fff297a99/users/3dabdec46da04d8cb60b4c40a8a5d506/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:05.473800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6f4d-30a8-4161-a113-776dec8cb4f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a23db5e059764d5ea9b02a5fff297a99, user_id=3dabdec46da04d8cb60b4c40a8a5d506, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:05.475256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6f4d-30a8-4161-a113-776dec8cb4f6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:05.494752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 580/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:06:05 2022] PUT /identity/v3/projects/a23db5e059764d5ea9b02a5fff297a99/users/3dabdec46da04d8cb60b4c40a8a5d506/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:06:07.621926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679af7-0983-41c4-bd25-69426fadfd6a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:07.622558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679af7-0983-41c4-bd25-69426fadfd6a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:07.622558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679af7-0983-41c4-bd25-69426fadfd6a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:07.623898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 574/1154] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:07.630321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:07.631116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:07.631354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:07.652099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:07.653347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:07.726756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 581/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:07.752477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679af7-0983-41c4-bd25-69426fadfd6a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:07.849348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:07.871266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679af7-0983-41c4-bd25-69426fadfd6a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:07.906426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:07.907241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:07.907532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:07.907813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:07.918039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:06:07.925913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:07.927052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:07.929589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:06:07.932174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 575/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:06:07.935410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:08.050933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:08.069089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fa272-65de-4726-bef4-eabd93fe689a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:08.106457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:08.107119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:08.107404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:08.107675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:08.108423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:08.108756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:08.110168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:08.118925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 582/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:06:08.125071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:08.226956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd818-ae3c-40c4-8d56-de7c9a663fec None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:08.274825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:08.276167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:08.276585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:08.276976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] PATH_INFO: `/v3/users/3dabdec46da04d8cb60b4c40a8a5d506` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:08.279100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=3dabdec46da04d8cb60b4c40a8a5d506)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:08.281520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:08.284059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 576/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:06:08 2022] GET /identity/v3/users/3dabdec46da04d8cb60b4c40a8a5d506 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:08.290021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:08.393397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca53092-fe74-4ef2-b8d0-a33bed11eb55 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:08.428503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:08.429182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:08.429462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:08.429747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:08.447499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:08.496302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:08.497764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:08.615940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 583/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:06:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:06:08.625474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:08.644266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:08.734289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608df7-5e9f-484e-a7a8-448cffd69fb8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:08.768630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e31839-5ce6-40a7-96c4-5243e4510351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:08.769431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e31839-5ce6-40a7-96c4-5243e4510351 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:08.769716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e31839-5ce6-40a7-96c4-5243e4510351 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:08.769989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e31839-5ce6-40a7-96c4-5243e4510351 None admin] PATH_INFO: `/v3/projects/a23db5e059764d5ea9b02a5fff297a99` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:08.771213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e31839-5ce6-40a7-96c4-5243e4510351 None admin] RBAC: Authorizing `identity:get_project(project_id=a23db5e059764d5ea9b02a5fff297a99)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:08.772693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e31839-5ce6-40a7-96c4-5243e4510351 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:08.774360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 577/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:06:08 2022] GET /identity/v3/projects/a23db5e059764d5ea9b02a5fff297a99 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:08.781364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:08.841606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:08.896088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79381885-b69b-44c6-bf64-5b1ad9fd193e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:08.930790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:08.931437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:08.931721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:08.931998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:08.932832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=a23db5e059764d5ea9b02a5fff297a99, user.id=3dabdec46da04d8cb60b4c40a8a5d506) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:08.933215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:08.934717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abad2e-b54f-4bbe-ba4b-3119e748a27d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:08.940591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 584/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:06:08 2022] GET /identity/v3/role_assignments?user.id=3dabdec46da04d8cb60b4c40a8a5d506&scope.project.id=a23db5e059764d5ea9b02a5fff297a99&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:11.179104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f5278-dd0b-4739-a44a-347c181db8d8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:11.179969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f5278-dd0b-4739-a44a-347c181db8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:11.179969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f5278-dd0b-4739-a44a-347c181db8d8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:11.182186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 578/1162] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:11.192046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:11.192488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:11.192639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:11.218345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:11.219559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:11.291224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 585/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:11.327203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f5278-dd0b-4739-a44a-347c181db8d8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:11.412806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:11.442717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f5278-dd0b-4739-a44a-347c181db8d8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:11.484778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:11.485443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:11.485730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:11.486000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:11.554355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:11.556148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:11.641452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:11.665443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 579/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:06:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:06:11.672296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:11.721490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:11.784235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e1117-52da-4774-8497-2d2827941ab6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:11.828281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:11.829142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:11.829426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:11.829705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:11.836755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:11.838283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-314c3c18-642a-46da-a5cd-dc12ca78048b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:11.852914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:11.854114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:06:11.855007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 586/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:06:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:06:11.860634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:11.968805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575639-228b-49f0-a362-5bb50e71f822 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:12.006833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:12.007434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:12.007719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:12.007999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:12.008745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:12.009063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:12.010456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02f5f5-3e4b-4189-a53f-dbb646c9235a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:12.018050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 580/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 17:06:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:14.200568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b54ac-c3a8-448b-a2a7-dc3492ec173f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:14.201301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b54ac-c3a8-448b-a2a7-dc3492ec173f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:14.201301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b54ac-c3a8-448b-a2a7-dc3492ec173f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:14.202520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 587/1167] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:14.209175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b708-03dc-4671-96c1-a3d12ec037cd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:14.209874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b708-03dc-4671-96c1-a3d12ec037cd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:14.210187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b708-03dc-4671-96c1-a3d12ec037cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:14.231648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8136b708-03dc-4671-96c1-a3d12ec037cd None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:14.232878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8136b708-03dc-4671-96c1-a3d12ec037cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:14.277204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:14.315900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 581/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:14.339028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b54ac-c3a8-448b-a2a7-dc3492ec173f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:14.448379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b54ac-c3a8-448b-a2a7-dc3492ec173f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:14.450218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:14.483327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dacbc4-8fb1-473e-a844-7b56d889742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:14.483923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dacbc4-8fb1-473e-a844-7b56d889742e None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:14.484201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dacbc4-8fb1-473e-a844-7b56d889742e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:14.484476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dacbc4-8fb1-473e-a844-7b56d889742e None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:14.485255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dacbc4-8fb1-473e-a844-7b56d889742e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:14.486647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dacbc4-8fb1-473e-a844-7b56d889742e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:14.510004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 588/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Mon May 23 17:06:14 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:06:16.674597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f312824-6c91-4fd0-a094-3d34d5bfc382 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:16.675459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f312824-6c91-4fd0-a094-3d34d5bfc382 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:16.675459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f312824-6c91-4fd0-a094-3d34d5bfc382 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:16.677832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 582/1170] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:16.684253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:16.684967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:16.685217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:16.708229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:16.709470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:16.788848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 589/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:16.814196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f312824-6c91-4fd0-a094-3d34d5bfc382 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:16.924412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f312824-6c91-4fd0-a094-3d34d5bfc382 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:16.961603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e56e3-f1c9-4301-9618-659e96ef99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:16.962403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e56e3-f1c9-4301-9618-659e96ef99f7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:16.962685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e56e3-f1c9-4301-9618-659e96ef99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:16.962956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e56e3-f1c9-4301-9618-659e96ef99f7 None admin] PATH_INFO: `/v3/domains/9bec905ef5ca4bfbaa13e5785783af2e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:16.973511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e56e3-f1c9-4301-9618-659e96ef99f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9bec905ef5ca4bfbaa13e5785783af2e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:16.974993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e56e3-f1c9-4301-9618-659e96ef99f7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:16.976648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 583/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Mon May 23 17:06:16 2022] GET /identity/v3/domains/9bec905ef5ca4bfbaa13e5785783af2e => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:16.982645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:17.077375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:17.087162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3751807-fd00-4de6-a9b4-37b07b7926d8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:17.122588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0effae4-9836-4bb6-8097-c6c36b149016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:17.123246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0effae4-9836-4bb6-8097-c6c36b149016 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:17.123534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0effae4-9836-4bb6-8097-c6c36b149016 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:17.123814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0effae4-9836-4bb6-8097-c6c36b149016 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:17.124506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0effae4-9836-4bb6-8097-c6c36b149016 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:17.125977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0effae4-9836-4bb6-8097-c6c36b149016 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:17.161055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 590/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:06:16 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:06:19.387895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467d6a-0633-42e8-8571-1a0ac00df0e9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:19.388838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467d6a-0633-42e8-8571-1a0ac00df0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:19.388838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467d6a-0633-42e8-8571-1a0ac00df0e9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:19.391359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 584/1174] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:19.400180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:19.400592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:19.400855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:19.419962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:19.421208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:19.491041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 591/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:19.517606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467d6a-0633-42e8-8571-1a0ac00df0e9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:19.555312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:19.630958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467d6a-0633-42e8-8571-1a0ac00df0e9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:19.666442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b634e-b5d4-4c5d-9083-3c560241310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:19.667324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b634e-b5d4-4c5d-9083-3c560241310d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:19.667607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b634e-b5d4-4c5d-9083-3c560241310d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:19.667885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b634e-b5d4-4c5d-9083-3c560241310d None admin] PATH_INFO: `/v3/domains/9bec905ef5ca4bfbaa13e5785783af2e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:19.669250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b634e-b5d4-4c5d-9083-3c560241310d None admin] RBAC: Authorizing `identity:get_domain(domain_id=9bec905ef5ca4bfbaa13e5785783af2e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:19.670716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b634e-b5d4-4c5d-9083-3c560241310d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:19.672324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 585/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Mon May 23 17:06:19 2022] GET /identity/v3/domains/9bec905ef5ca4bfbaa13e5785783af2e => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:19.678416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:19.756318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:19.786242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadea8ac-a6fe-4c7b-b59b-91f688a46e42 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:19.820457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7300421-26e6-49f7-b958-1983f7d0b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:19.821172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300421-26e6-49f7-b958-1983f7d0b429 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:19.821459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300421-26e6-49f7-b958-1983f7d0b429 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:19.821735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300421-26e6-49f7-b958-1983f7d0b429 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:19.822459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7300421-26e6-49f7-b958-1983f7d0b429 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:19.823938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7300421-26e6-49f7-b958-1983f7d0b429 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:19.849938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 592/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:06:19 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:06:22.086582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d1540-1c97-4c2e-95a7-dceee19ca367 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:22.087093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d1540-1c97-4c2e-95a7-dceee19ca367 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:22.087093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d1540-1c97-4c2e-95a7-dceee19ca367 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:22.089236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 586/1178] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:22.098091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:22.098512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:22.098700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:22.120235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:22.121477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:22.194534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 593/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:22.218324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d1540-1c97-4c2e-95a7-dceee19ca367 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:22.325878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:22.332419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d1540-1c97-4c2e-95a7-dceee19ca367 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:22.372100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:22.372862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:22.373147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:22.373426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:22.384049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:06:22.392048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:22.393147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:06:22.394004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 587/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:06:22.400268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:22.466104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:22.509522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edb74c-b33c-475b-b043-60416c4a9d40 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:22.545603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:22.546269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:22.546552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:22.546824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:22.547565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:22.547871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:22.549293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:22.558456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 594/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:22.567530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:22.674181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343b16-db0e-428f-8004-50a729c0dbc6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:22.709612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:22.710521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:22.710807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:22.711085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] PATH_INFO: `/v3/users/848fe8b275204755b7e439a14c3ad632` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:22.731265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=848fe8b275204755b7e439a14c3ad632)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:22.732803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:22.734492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 588/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:06:22 2022] GET /identity/v3/users/848fe8b275204755b7e439a14c3ad632 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:22.741382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:22.853070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ddcd7-8cae-4f52-a9ef-3c7358fea91e None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:22.879843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:22.892571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:22.893248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:22.893540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:22.893812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:22.960148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:22.961572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:23.073298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 595/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:06:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:06:23.079457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:23.099499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:23.183137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a038b1-2436-4b28-875f-eab6ee96b0b0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:23.217821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140990-4118-4824-9377-cdb9c77ba855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:23.218618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140990-4118-4824-9377-cdb9c77ba855 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:23.218903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140990-4118-4824-9377-cdb9c77ba855 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:23.219177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140990-4118-4824-9377-cdb9c77ba855 None admin] PATH_INFO: `/v3/projects/00523c79889c44e082ba9c3b03e3a746` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:23.220400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a140990-4118-4824-9377-cdb9c77ba855 None admin] RBAC: Authorizing `identity:get_project(project_id=00523c79889c44e082ba9c3b03e3a746)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:23.221878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a140990-4118-4824-9377-cdb9c77ba855 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:23.223526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 589/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:06:23 2022] GET /identity/v3/projects/00523c79889c44e082ba9c3b03e3a746 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:23.230588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:23.261354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:23.341570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98c13-0e73-46c0-8f5e-0d4c1109403a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:23.376872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:23.377524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:23.377809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:23.378085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:23.378928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=00523c79889c44e082ba9c3b03e3a746, user.id=848fe8b275204755b7e439a14c3ad632) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:23.379232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:23.380674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65f412-3f81-48c9-be6c-d94fb14de40c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:23.386288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 596/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:06:23 2022] GET /identity/v3/role_assignments?user.id=848fe8b275204755b7e439a14c3ad632&scope.project.id=00523c79889c44e082ba9c3b03e3a746&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:25.510226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbed41-8e75-4d1a-bda6-e079b45c14a2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:25.510860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbed41-8e75-4d1a-bda6-e079b45c14a2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:25.510860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbed41-8e75-4d1a-bda6-e079b45c14a2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:25.512255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 590/1186] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:25.519151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:25.519907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:25.520080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:25.545543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:25.546733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:25.621465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 597/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:25.644773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbed41-8e75-4d1a-bda6-e079b45c14a2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:25.737497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:25.754575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbed41-8e75-4d1a-bda6-e079b45c14a2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:25.791776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:25.792519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:25.792840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:25.793117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:25.804941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:06:25.812537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:25.813595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:06:25.814467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 591/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:06:25.819933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:25.838194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:25.926874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471d3f-e59d-4e81-9325-11fe1d3ec536 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:25.964181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:25.964906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:25.965185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:25.965528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:25.966280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:25.966584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:25.967983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:25.976054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 598/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:25.982952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:26.090302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59876d60-820e-4251-abd9-77d441f53f1b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:26.125869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:26.126744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:26.127027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:26.127301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] PATH_INFO: `/v3/users/848fe8b275204755b7e439a14c3ad632` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:26.128530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] RBAC: Authorizing `identity:get_user(user_id=848fe8b275204755b7e439a14c3ad632)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:26.130026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:26.131626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 592/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:06:25 2022] GET /identity/v3/users/848fe8b275204755b7e439a14c3ad632 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:26.137650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:26.218945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:26.241646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20f2a-309d-4853-bbcb-606391007e8c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:26.275865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19cec-3f88-4ba8-8f70-657154f71047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:26.276743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19cec-3f88-4ba8-8f70-657154f71047 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:26.277023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19cec-3f88-4ba8-8f70-657154f71047 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:26.277302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19cec-3f88-4ba8-8f70-657154f71047 None admin] PATH_INFO: `/v3/projects/00523c79889c44e082ba9c3b03e3a746` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:26.278516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd19cec-3f88-4ba8-8f70-657154f71047 None admin] RBAC: Authorizing `identity:get_project(project_id=00523c79889c44e082ba9c3b03e3a746)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:26.279962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd19cec-3f88-4ba8-8f70-657154f71047 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:26.281684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 599/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:06:26 2022] GET /identity/v3/projects/00523c79889c44e082ba9c3b03e3a746 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:26.288444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:26.307121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:26.392260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428781-1f8e-4907-87d3-bd551934c739 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:26.426690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56938f-a3f2-4225-b0b7-a092e4b17968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:26.427594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56938f-a3f2-4225-b0b7-a092e4b17968 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:26.427873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56938f-a3f2-4225-b0b7-a092e4b17968 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:26.428154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56938f-a3f2-4225-b0b7-a092e4b17968 None admin] PATH_INFO: `/v3/projects/00523c79889c44e082ba9c3b03e3a746/users/848fe8b275204755b7e439a14c3ad632/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:26.430407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56938f-a3f2-4225-b0b7-a092e4b17968 None admin] RBAC: Authorizing `identity:create_grant(project_id=00523c79889c44e082ba9c3b03e3a746, user_id=848fe8b275204755b7e439a14c3ad632, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:26.431870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56938f-a3f2-4225-b0b7-a092e4b17968 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:26.448011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 593/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:06:26 2022] PUT /identity/v3/projects/00523c79889c44e082ba9c3b03e3a746/users/848fe8b275204755b7e439a14c3ad632/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:06:28.590172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209217e-d24d-437c-86b0-fa596a174577 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:28.591082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209217e-d24d-437c-86b0-fa596a174577 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:28.591082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209217e-d24d-437c-86b0-fa596a174577 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:28.593380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 600/1193] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:06:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:06:28.600654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:28.601065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:28.601699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:28.623355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:06:28.624611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:06:28.696113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 594/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:06:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:06:28.720038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209217e-d24d-437c-86b0-fa596a174577 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:28.832199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209217e-d24d-437c-86b0-fa596a174577 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:28.866968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:28.867713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:28.868003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:28.868289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:28.879735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:06:28.887470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:06:28.888534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:06:28.890265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 601/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:06:28.898565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:28.903376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:29.003384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e06b-19ea-47b3-928c-f691e74a1fa9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:29.038674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:29.039342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:29.039621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:29.039899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:29.040662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:29.041012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:29.042394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:29.050787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 595/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:29.059738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:29.068933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:29.165039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c06fc-3f4a-4604-8a8b-bc6fab6eb015 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:29.199699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:29.200559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:29.200879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:29.201151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] PATH_INFO: `/v3/users/848fe8b275204755b7e439a14c3ad632` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:29.202447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] RBAC: Authorizing `identity:get_user(user_id=848fe8b275204755b7e439a14c3ad632)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:29.203894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:29.205530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 602/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 17:06:29 2022] GET /identity/v3/users/848fe8b275204755b7e439a14c3ad632 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:29.211626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:29.280359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:29.322268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709b7ec-1855-41df-9a06-e24b2d49913a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:29.371537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:29.372196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:29.372489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:29.372793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:29.444370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:29.445804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:29.509868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:29.545499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 596/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:06:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:06:29.551932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:29.631504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:29.666379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930babda-365e-497f-9bd6-7b39f2e959a8 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:29.707071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107cb3-fc59-4b9a-ba35-0fb4047d0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:29.707878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107cb3-fc59-4b9a-ba35-0fb4047d0df9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:29.708159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107cb3-fc59-4b9a-ba35-0fb4047d0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:29.708432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107cb3-fc59-4b9a-ba35-0fb4047d0df9 None admin] PATH_INFO: `/v3/projects/00523c79889c44e082ba9c3b03e3a746` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:29.709896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107cb3-fc59-4b9a-ba35-0fb4047d0df9 None admin] RBAC: Authorizing `identity:get_project(project_id=00523c79889c44e082ba9c3b03e3a746)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:29.711382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107cb3-fc59-4b9a-ba35-0fb4047d0df9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:29.713152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 603/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 17:06:29 2022] GET /identity/v3/projects/00523c79889c44e082ba9c3b03e3a746 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:29.720770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:06:29.838667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e35a3-52d2-46e6-887f-e0e478ea1ea1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:06:29.879115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:06:29.879776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:06:29.880065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:06:29.880344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:06:29.881215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=00523c79889c44e082ba9c3b03e3a746, user.id=848fe8b275204755b7e439a14c3ad632) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:06:29.881562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:06:29.883028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d8ff5-9c10-485e-a763-a6f7f95ed070 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:06:29.889092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 597/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:06:29 2022] GET /identity/v3/role_assignments?user.id=848fe8b275204755b7e439a14c3ad632&scope.project.id=00523c79889c44e082ba9c3b03e3a746&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:06:39.701247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=29 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:06:39.886641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=85 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:30.469451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b7eb5-124b-4871-9102-8991ac73189c None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:30.470079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b7eb5-124b-4871-9102-8991ac73189c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:30.470079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b7eb5-124b-4871-9102-8991ac73189c None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:30.471460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 604/1201] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:30.480346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:30.480346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:30.480346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:30.497186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:30.498631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:30.585956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 598/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:30.611174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b7eb5-124b-4871-9102-8991ac73189c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:30.745114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b7eb5-124b-4871-9102-8991ac73189c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:30.788161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:30.788161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:30.788523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:30.788841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:30.804993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:30.807020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:30.826965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:30.828206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:30.829599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:30.829599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:30.829599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:30.829599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:30.829599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 605/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:07:30.834448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:30.959935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76f2f7-34fc-4ec9-b438-7c00687b1c0b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:31.002634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:31.009130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:31.010090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:31.010581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:31.010874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:31.011704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:31.012222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:31.017635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0139b2-a7cf-4e7a-9842-dad1934dd7d8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:31.036652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 599/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:31.039774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:31.103997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:31.171397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9765b4-0e11-4c67-8014-e9c28eb946cc None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:31.214092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f441c-c032-4b3f-9328-64ae34583af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:31.215055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f441c-c032-4b3f-9328-64ae34583af3 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:31.215353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f441c-c032-4b3f-9328-64ae34583af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:31.215803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f441c-c032-4b3f-9328-64ae34583af3 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:31.216758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f441c-c032-4b3f-9328-64ae34583af3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:31.218475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f441c-c032-4b3f-9328-64ae34583af3 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:31.256730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 606/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 17:07:31 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:07:33.787348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ea81-08ea-451c-aa69-c47d9ad14c3e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:33.787902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ea81-08ea-451c-aa69-c47d9ad14c3e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:33.787902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ea81-08ea-451c-aa69-c47d9ad14c3e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:33.789353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 600/1206] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:33.795562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b92ae-7571-4329-b110-646adf818385 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:33.796094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b92ae-7571-4329-b110-646adf818385 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:33.796094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b92ae-7571-4329-b110-646adf818385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:33.814512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-628b92ae-7571-4329-b110-646adf818385 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:33.815743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-628b92ae-7571-4329-b110-646adf818385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:33.897833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 607/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:33.924854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ea81-08ea-451c-aa69-c47d9ad14c3e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:34.045712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ea81-08ea-451c-aa69-c47d9ad14c3e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:34.082539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:34.083842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:34.083842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:34.084026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:34.095323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:07:34.102419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:34.104192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:34.105071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 601/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:07:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:34.110145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b92ae-7571-4329-b110-646adf818385 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:34.158443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:34.228213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b92ae-7571-4329-b110-646adf818385 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:34.267131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:34.267836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:34.269329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:34.269329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:34.269329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:34.276376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:34.276376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:34.285584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 608/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:34.291595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:34.348640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:34.408700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f03f6-bb91-49ac-bccd-537c03cf3e86 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:34.449510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:34.450400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:34.450755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:34.451173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:34.464092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:34.465851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:34.488745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:34.490040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:34.490986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:34.490986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:34.490986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:34.490986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:34.490986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 602/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:34.496549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:34.623843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:34.627264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7743f0-e224-46e5-8db8-8eea433b409a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:34.665051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:34.665782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:34.666025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:34.666463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:34.667198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:34.667516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:34.669410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:34.684916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 609/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:07:34.691503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:34.812320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1d88-273e-4c4f-ac3c-704b750cf347 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:34.814167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:34.850152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:34.851130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:34.851538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:34.851905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:34.859634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:34.861308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:07:34.877252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:34.878295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:34.879275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 603/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:07:34.884548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:35.014582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a31c8-ebeb-4a6d-bc27-8cd2c4546a31 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:35.058388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:35.059147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:35.059420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:35.059700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:35.060562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:35.060903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:35.062389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:35.081932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 610/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 17:07:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:35.089636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:35.206977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087e2d7-9164-46a6-9817-ddf04f359b1f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:35.245978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:35.246704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:35.246995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:35.247334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:35.283825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:35.325873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:35.327360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:35.441706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 604/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:07:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:07:35.447574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:35.469006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:35.565740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f4bd9-00e2-4819-91e5-cad95bd1d373 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:35.616771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:35.618469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:35.619051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:35.619672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:35.633375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:35.635747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:35.661214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:35.662209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:35.663109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:35.663109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:35.663109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:35.663109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:35.666850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 611/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:35.677606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:35.750495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:35.801778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520468-5aaa-44c8-9339-2b04d162caa5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:35.844529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:35.845379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:35.845537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:35.845809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:35.846538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:35.846888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:35.848583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:35.862263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 605/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:07:35.867674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:35.946398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:35.991135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128aa11-01d7-41de-8f85-11803c8809c6 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:36.030694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:36.031493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:36.031835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:36.032174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:36.041455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:36.043661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:07:36.060035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:36.061043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:36.066668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 612/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:07:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:36.067262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:36.179445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe5e19-579d-408f-99d8-2007d3144792 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:36.205720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:36.218235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:36.218910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:36.219193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:36.219471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:36.220260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:36.220570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:36.222049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477acf4-2f00-4c48-be5f-e33da3dd1186 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:36.234835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 606/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:36.242363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:36.366497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228dfc-af74-43ed-ab97-73fbcab6ce77 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:36.400433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:36.407513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:36.408200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:36.408488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:36.408798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:36.409654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=08c27893964a4cc2a798f33a91844833) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:36.409928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:36.411642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c92a3-bda1-4311-a73f-6081131488b8 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:36.417731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 613/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:07:36 2022] GET /identity/v3/role_assignments?user.id=08c27893964a4cc2a798f33a91844833&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:38.710225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55e05-5b7e-46b4-99a5-8bf9ec342995 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:38.710834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55e05-5b7e-46b4-99a5-8bf9ec342995 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:38.710834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55e05-5b7e-46b4-99a5-8bf9ec342995 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:38.712413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 607/1220] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:07:38.718270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:38.718716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:38.718841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:38.737510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:38.738800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:38.806574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 614/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:38.829434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55e05-5b7e-46b4-99a5-8bf9ec342995 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:38.939851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55e05-5b7e-46b4-99a5-8bf9ec342995 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:38.977627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:38.978371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:38.978655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:38.978929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:38.989084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:07:38.998436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:38.999710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:39.001185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 608/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:07:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:39.006680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:39.110385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696d268-7ebd-4197-8703-34bbda84c0f3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:39.134638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:39.147148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:39.147924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:39.148209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:39.148532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:39.149436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:39.149736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:39.151326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:39.164861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 615/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:07:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:39.166332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:39.211926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:39.270830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99222f-fe81-4e5e-ae52-11a0d99f5aa8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:39.305220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:39.306029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:39.306313 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:39.306591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:39.319551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:39.323235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:39.344215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:39.345547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:39.346457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:39.346457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:39.346457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:39.346457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:39.346457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 609/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:39.352376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:39.469911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b100-fd4c-47d6-ba32-d471ec0a7a8c None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:39.504007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:39.504626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:39.505115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:39.505227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:39.506071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:39.506334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:39.507958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:39.521423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 616/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:39.527079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:39.634856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:39.642651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1010-ac49-4394-bfa1-fae5fa1cdaf2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:39.680056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:39.680994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:39.681207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:39.681486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:39.689670 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:39.691262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:07:39.707298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:39.708504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:39.709929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 610/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:39.716423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:39.770119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:39.829910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3bc94-3299-4ca6-b40c-e5744e2149d4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:39.866467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:39.867260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:39.867545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:39.867822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:39.868696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:39.869003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:39.870634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:39.890845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 617/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 17:07:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:39.897844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:40.013996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d053e-4c93-4dc0-9cd4-d07d9a0c2241 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:40.051216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:40.051994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:40.052276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:40.052734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:40.065476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:40.067228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:40.085533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:40.086508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:40.087450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:40.087450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:40.087450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:40.087450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:40.087450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 611/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:40.093037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:40.210968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6ed32-253e-4c0e-a792-66638da7ebb9 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:40.213403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:40.252638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:40.252638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:40.252638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:40.253185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:40.254091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:40.254470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:40.255957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:40.268998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 618/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:40.274685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:40.285789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:40.391642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7115-18fa-4a99-91bf-bcf857f5b611 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:40.434956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:40.435880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:40.436152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:40.436427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:40.445306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:40.447137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:07:40.465740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:40.466845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:40.467939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:40.468527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 612/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:07:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:40.474094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:40.598690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a274-fb99-4813-a811-dc494bf40545 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:40.640933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:40.641829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:40.642204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:40.642617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:40.644110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:40.644515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:40.647466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1684fd-5229-434c-81e7-b1de85ab5160 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:40.664344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 619/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:40.672065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:40.748584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:40.791643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf19a4-8319-4d06-968e-ac4cd40eec7c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:40.827911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c322e5b-1cbf-4c01-96cc-78636d2f798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:40.829003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c322e5b-1cbf-4c01-96cc-78636d2f798c None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:40.829312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c322e5b-1cbf-4c01-96cc-78636d2f798c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:40.829596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c322e5b-1cbf-4c01-96cc-78636d2f798c None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/08c27893964a4cc2a798f33a91844833/roles/14f437abc938447eb78033cefa5ecaf6` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:40.845879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c322e5b-1cbf-4c01-96cc-78636d2f798c None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=08c27893964a4cc2a798f33a91844833, role_id=14f437abc938447eb78033cefa5ecaf6)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:40.847619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c322e5b-1cbf-4c01-96cc-78636d2f798c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:40.861835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 613/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:07:40 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/08c27893964a4cc2a798f33a91844833/roles/14f437abc938447eb78033cefa5ecaf6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:07:43.150583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcba86-1c68-4865-9b41-b7bb2be2e0c7 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:43.151143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcba86-1c68-4865-9b41-b7bb2be2e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:43.151143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcba86-1c68-4865-9b41-b7bb2be2e0c7 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:43.152559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 620/1233] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:07:43.158252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:43.158678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:43.158802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:43.176388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:43.178193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:43.249215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 614/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:43.274588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcba86-1c68-4865-9b41-b7bb2be2e0c7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:43.300535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:43.383441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcba86-1c68-4865-9b41-b7bb2be2e0c7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:43.419369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:43.420187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:43.420459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:43.420801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:43.431427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:07:43.439328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:43.440447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:43.441703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 621/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 17:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:43.447291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:43.505917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:43.568567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71401-0ca8-49dc-88d4-cce44aa3a3fd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:43.615892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:43.616934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:43.617489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:43.617756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:43.618608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:43.618905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:43.620635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:43.630054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 615/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 17:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:43.638117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:43.735689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:43.757015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b98e-79cf-45cc-9a4f-8c61ce117f24 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:43.802907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:43.803795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:43.804116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:43.804389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:43.816119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:43.817694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:43.836545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:43.837599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:43.838569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:43.838569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:43.838569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:43.838569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:43.838569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 622/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:43.844405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:43.961150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a41435-36c2-483f-8fac-b2b2684567dd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:43.972201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:44.004705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:44.005305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:44.005603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:44.005870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:44.006638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:44.006959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:44.008381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:44.026137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 616/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:44.034126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:44.155117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413714-db6f-4b35-9295-64c536f78ec4 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:44.192365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:44.193408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:44.193715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:44.194016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:44.197166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:44.203482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:44.205573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:07:44.223086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:44.224468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:44.225830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:44.229617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 623/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:44.230722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:44.347434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99572-9907-4810-9e85-5e65e5fd2ff9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:44.390424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:44.391423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:44.391775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:44.392093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:44.393367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:44.393738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:44.395578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:44.420512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 617/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 17:07:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:44.421887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:44.532207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8079-963e-4371-bd3c-dab03df1d193 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:44.570622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:44.571297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:44.571589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:44.571870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:44.664335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:44.671927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:44.674151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:44.787045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 624/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:07:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:07:44.792940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:44.822857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:44.900031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa599b-ca7d-4eae-aee6-da04a96d0cdc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:44.938121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:44.938870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:44.939161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:44.939442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:44.951067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:44.952541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:44.969841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:44.970913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:44.971864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:44.971864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:44.971864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:44.971864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:44.971864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 618/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:07:44.976972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:45.078923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:45.085289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208368a-b9a3-4094-ac93-0e813e43c365 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:45.120767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:45.121799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:45.122121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:45.122436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:45.123900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:45.124256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:45.126229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:45.140471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 625/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:45.146131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:45.227122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:45.250243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbf3bf-799b-49f4-bacf-db17c60172ce None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:45.288477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:45.289329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:45.289616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:45.289895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:45.296883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:45.298365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:07:45.312060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:45.313124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:45.314011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 619/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:45.319268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:45.429690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e3787-bd4d-4053-9249-dd5586b2ebe6 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:45.470528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:45.471209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:45.471519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:45.471841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:45.472820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:45.473139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:45.474768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b99c6-2862-4fae-8bca-d01a335f490c None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:45.488944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 626/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:45.495157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:45.628656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d99ec-c3f8-45e0-bcbd-89ec6f3548ed None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:45.666922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:45.667627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:45.667969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:45.668265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:45.669141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] RBAC: Adding query filter params (role.id=14f437abc938447eb78033cefa5ecaf6, scope.project.id=444a244a713944db9caf259034ccd231, user.id=08c27893964a4cc2a798f33a91844833) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:45.669486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:45.671086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8df18c-247a-429f-ba15-8b08c59f62d9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:45.677708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 620/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:07:45 2022] GET /identity/v3/role_assignments?user.id=08c27893964a4cc2a798f33a91844833&scope.project.id=444a244a713944db9caf259034ccd231&role.id=14f437abc938447eb78033cefa5ecaf6 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:48.119631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec12d8-076a-4112-a340-50d18e5b0566 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:48.120156 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec12d8-076a-4112-a340-50d18e5b0566 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:48.120322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec12d8-076a-4112-a340-50d18e5b0566 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:48.122101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 627/1247] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:48.128188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:48.128656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:48.128780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:48.135317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:48.149406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:48.150616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:48.224697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 621/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:48.246961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec12d8-076a-4112-a340-50d18e5b0566 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:48.265843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:48.366362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec12d8-076a-4112-a340-50d18e5b0566 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:48.408340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:48.409249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:48.409768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:48.409943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:48.423197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:07:48.431351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:48.432397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:48.433388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 628/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:48.439004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:48.545109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61331551-5f54-49ab-bcb7-0095ff10e8e3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:48.580426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:48.587281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:48.588382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:48.588785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:48.589263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:48.590083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:48.590394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:48.591787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:48.604289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 622/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:48.614315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:48.707485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:48.734587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959809-18a9-4eca-bf5b-7427b113f6c3 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:48.771708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:48.772539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:48.772850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:48.773125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:48.784168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:48.785703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:48.810077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:48.811160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:48.812108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:48.812108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:48.812108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:48.812108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:48.812108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 629/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:48.817572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:48.938979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3668377-d02f-4157-a5d4-188e9b05496f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:48.977356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:48.978159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:48.978476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:48.978760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:48.979681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:48.980027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:48.981782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:48.995987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 623/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:49.002060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:49.115498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151145-fafc-476d-8dc3-9416661b604d None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:49.146972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:49.157145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:49.159071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:49.159538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:49.159830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:49.169054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:49.170797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:07:49.188538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:49.189772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:49.190739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 630/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:49.195957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:49.255673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:49.306094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac9c61-9084-4a9b-9838-1c83f71f225d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:49.341276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:49.341983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:49.342321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:49.342604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:49.343575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:49.343963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:49.345621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:49.365341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 624/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 17:07:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:49.371569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:49.480760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511be1-61f9-4d87-bc6a-8ad9c8e332cb None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:49.518346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:49.518944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:49.519229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:49.519510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:49.591304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:49.609664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:49.611892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:49.728944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 631/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:07:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:07:49.735983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:49.855198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2b71-21e3-44e3-bc38-d3e0e2698ddc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:49.872077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:49.896691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:49.897525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:49.897896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:49.898111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:49.910376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:49.911877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:49.931118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:49.932267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:49.933483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:49.933483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:49.933483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:49.933483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:49.933483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 625/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:49.938680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:50.033753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:50.047839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f98c3b-8fe9-4056-bca2-875411089825 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:50.084044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:50.084766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:50.085049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:50.085319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:50.086116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:50.086422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:50.087833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:50.101050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 632/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:50.106942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:50.213390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a705e4-422c-40e7-9d76-93236af36332 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:50.250243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:50.251073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:50.251362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:50.251641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:50.259587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:50.261147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:07:50.277113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:50.278252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:50.279190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 626/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:50.284889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:50.403017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd5f18-2fd0-4d26-ab47-66da7f3e4e83 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:50.436840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:50.437519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:50.437826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:50.438098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:50.438889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:50.439200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:50.440690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf78d44-1ac3-4ce6-b6d9-dc53ec28afc4 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:50.452765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 633/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:50.459230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:50.486160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:50.562840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de011203-f54a-4375-9821-c3449ea42b5e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:50.607985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:50.608711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:50.609007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:50.609416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:50.610134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=444a244a713944db9caf259034ccd231, user.id=08c27893964a4cc2a798f33a91844833) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:50.610449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:50.611923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2051-2d38-44cb-9604-90152b882ffa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:50.617975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 627/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:07:50 2022] GET /identity/v3/role_assignments?user.id=08c27893964a4cc2a798f33a91844833&scope.project.id=444a244a713944db9caf259034ccd231&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:52.792937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f527b-1d42-48fe-8953-4118980bfddd None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:52.793529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f527b-1d42-48fe-8953-4118980bfddd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:52.793529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f527b-1d42-48fe-8953-4118980bfddd None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:52.794877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 634/1261] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:52.800428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:52.800869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:52.800980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:52.819569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:52.820800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:52.890801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 628/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:52.915574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f527b-1d42-48fe-8953-4118980bfddd None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:52.927834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:53.023034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f527b-1d42-48fe-8953-4118980bfddd None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:53.058467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:53.059199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:53.059477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:53.059754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:53.070224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:07:53.077894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:53.078967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:53.080337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 635/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:53.089233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:53.107739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:53.200707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22f036-b8ec-46dc-9455-c01f7045c4f7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:53.237210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:53.237881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:53.238158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:53.238429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:53.239168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:53.239479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:53.240902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:53.248958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 629/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:07:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:53.255150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:53.324215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:53.363457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd6a4-499d-4e70-b66d-88cbb28884f5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:53.398572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:53.399361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:53.399640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:53.399917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:53.410782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:53.412270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:53.429347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:53.430361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:53.431444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:53.431444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:53.431444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:53.431444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:53.431444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 636/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:07:53.438344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:53.522455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:53.542659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d15a3-193a-4e3b-b979-9f7e05eb2f1f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:53.577845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:53.578536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:53.578818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:53.579126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:53.579939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:53.580284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:53.581851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:53.595694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 630/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:53.602276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:53.711611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41306071-8acf-45dc-a06f-303a5eeab085 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:53.733740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:53.749923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:53.750734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:53.751017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:53.751291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:53.758812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:53.760275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:07:53.774514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:53.775596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:53.781434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 637/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:53.782162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:53.890505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a266ad3-3d16-4f2c-b129-999112021515 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:53.927442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:53.928117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:53.928396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:53.928706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:53.929559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:53.929869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:53.931324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:53.940315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:53.949904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 631/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 17:07:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:07:53.955835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:54.069771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3d8b0-4411-4109-99b9-d00f6c5523e5 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:54.103724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:54.104517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:54.104952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:54.105294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:54.116131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:54.117638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:54.134719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:54.135743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:54.136939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:54.136939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:54.136939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:54.136939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:54.136939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 638/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:54.142889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:54.267998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c0016-73ca-45fc-aa91-c9a4bf9c2a91 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:54.305981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:54.306649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:54.306931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:54.307208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:54.307931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:54.308269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:54.309691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:54.321021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 632/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:54.327634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:54.362356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:54.436709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa1c7-1681-4c19-951d-0abe168412ad None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:54.471238 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:54.472042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:54.472324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:54.472631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:54.479561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:54.481104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:07:54.495440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:54.496579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:54.497611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 639/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:54.503605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:54.576136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:54.625049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0979480-7c00-4592-baed-b5de6a869d23 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:54.659994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:54.660683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:54.660974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:54.661249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:54.662041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:54.662353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:54.663816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53509a-9c81-422f-9067-58089c4fc1b8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:54.677539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 633/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:54.686202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:54.789467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:54.799019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8d9c-f2c3-4124-8907-531332fd15f1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:54.833442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7277768-b533-44b7-a469-5519cbe864a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:54.834336 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277768-b533-44b7-a469-5519cbe864a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:54.834614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277768-b533-44b7-a469-5519cbe864a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:54.834890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277768-b533-44b7-a469-5519cbe864a5 None admin] PATH_INFO: `/v3/projects/444a244a713944db9caf259034ccd231/users/08c27893964a4cc2a798f33a91844833/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:54.836981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7277768-b533-44b7-a469-5519cbe864a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=444a244a713944db9caf259034ccd231, user_id=08c27893964a4cc2a798f33a91844833, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:54.838443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7277768-b533-44b7-a469-5519cbe864a5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:54.852262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 640/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 17:07:54 2022] PUT /identity/v3/projects/444a244a713944db9caf259034ccd231/users/08c27893964a4cc2a798f33a91844833/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:07:57.039404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38703-fec2-4b32-b3d2-9bd785bbd9ff None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:57.040248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38703-fec2-4b32-b3d2-9bd785bbd9ff None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:57.040358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38703-fec2-4b32-b3d2-9bd785bbd9ff None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:57.042654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 634/1274] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:07:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:07:57.049343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:57.049786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:57.049786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:57.076119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:07:57.077367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:07:57.149132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 641/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:07:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:07:57.173365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae38703-fec2-4b32-b3d2-9bd785bbd9ff None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:57.282288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae38703-fec2-4b32-b3d2-9bd785bbd9ff None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:57.300696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:57.320881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:57.321701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:57.321974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:57.322270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:57.333136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:07:57.341000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:57.342089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:57.343207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 635/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 17:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:57.351097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:57.440073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:57.459691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943d2ae-931a-4d2a-877b-2f16aa7c9af3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:57.495523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:57.496250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:57.496530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:57.496847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:57.497593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:57.497902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:57.499327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:57.507640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 642/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 17:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:57.513673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:57.625348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0085-9164-482e-9634-41185c1524e8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:57.662431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:57.663238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:57.663519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:57.663790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:57.674304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:57.675766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:57.692636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:57.693717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:57.695029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:57.695029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:57.695029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:57.695029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:57.695029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 636/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:57.699828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:57.809366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9a6-c65e-4329-888c-c09aacc76f88 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:57.854325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:57.854999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:57.855354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:57.855637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:57.856366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:57.856702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:57.858113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:57.870207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 643/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:57.876528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:57.912686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:57.989095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1782ae3-7fdb-4e8f-bfdb-10b59c505566 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:58.024730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:58.025547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:58.025834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:58.026113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:58.034128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:58.035562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:07:58.050421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:58.053205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:07:58.054405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 637/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:58.058296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:58.063003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:58.167232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07565c-baca-46e7-b779-31ec283fc3e1 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:58.203784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:58.204461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:58.204776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:58.205053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:58.205897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:58.206206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:58.207672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:58.226421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 644/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 17:07:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:58.232594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:58.328339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:58.342202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f458c-33a2-41e0-87ca-7ea75c9d33b0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:58.377442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:58.378098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:58.378376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:58.378652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:58.448677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:58.450319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:58.538434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:58.549856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 638/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 17:07:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:07:58.556141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:58.617689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:58.656762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fdf61-f353-4b56-a272-d223215173b0 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:58.691661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:58.692446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:58.692759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:58.693031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:58.703359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:58.704860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:07:58.722339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:58.723354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:58.724479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:07:58.724479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:07:58.724479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:07:58.724479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:58.728151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 645/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:07:58.729309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:58.831340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9dd3-883b-4654-a522-1e2707de782d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:58.864881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:58.865550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:58.865834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:58.866112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:58.866835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:58.867146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:58.868536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:58.879369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 639/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 17:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:07:58.888197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:58.991219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fe7f8-3e33-4358-987d-ca4ae60db940 None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:59.006576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:59.031300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:59.032093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:59.032376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:59.032648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:59.039587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:59.041086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:07:59.054781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application with Lock( May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._enter() May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.creator() May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:07:59.055869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application created_value = creator( May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: ERROR keystone.server.flask.application May 23 17:07:59.056953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 646/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 17:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:07:59.062235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:59.111799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:07:59.167695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853f448-d748-43f2-9aba-13a432aa0624 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:59.203856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:59.204531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:59.204858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:59.205139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:59.205967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:59.206362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:59.207829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa259-0ec0-49ee-aa1c-890820384bdb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:59.220342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 640/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 17:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:07:59.230440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:07:59.359232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda8aaf-016d-49e5-87a0-d93d5ada361a None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:07:59.397548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:07:59.398204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:07:59.398491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:07:59.398770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:07:59.399603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] RBAC: Adding query filter params (role.id=7fac209687fe417482cb8fa1e13ddbbe, scope.project.id=444a244a713944db9caf259034ccd231, user.id=08c27893964a4cc2a798f33a91844833) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:07:59.399910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:07:59.401414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c41a-db5d-4745-949f-21e4daa32a5d None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:07:59.407960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 647/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 17:07:59 2022] GET /identity/v3/role_assignments?user.id=08c27893964a4cc2a798f33a91844833&scope.project.id=444a244a713944db9caf259034ccd231&role.id=7fac209687fe417482cb8fa1e13ddbbe => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:01.620562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce17fd5-fcd2-401b-b8a6-06d0d5783f77 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:01.621158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce17fd5-fcd2-401b-b8a6-06d0d5783f77 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:01.621158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce17fd5-fcd2-401b-b8a6-06d0d5783f77 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:01.623041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 641/1288] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:08:01.629003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:01.629467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:01.629559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:01.649402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:01.650812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:01.686625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:01.725938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 648/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:08:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:08:01.749440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce17fd5-fcd2-401b-b8a6-06d0d5783f77 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:01.858785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce17fd5-fcd2-401b-b8a6-06d0d5783f77 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:01.869243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:01.896584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:01.897368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:01.897655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:01.897932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:01.898587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:01.899990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:08:01.912319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:08:01.913508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:01.914525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 642/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:08:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:08:01.920456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:02.031513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9de49-e06a-45eb-ac3d-c0426842ed0d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:02.078191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:02.078862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:02.079141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:02.079417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:02.080129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:02.080433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:02.081863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c966d-5cce-406b-9c9e-d9dce4d7d558 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:02.087629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 649/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 17:08:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:02.094049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:02.202675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34554e3-c000-4fcc-89ec-40cc9a46d733 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:02.237976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:02.238639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:02.238931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:02.239211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:02.239916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] RBAC: Adding query filter params (type=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:02.240226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:02.241658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2886-77d3-4a68-91df-bd3f69cb38ce None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:02.246427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 643/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 17:08:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:04.390548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16907-8e3a-40c1-bfa7-749df007565d None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:04.391470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16907-8e3a-40c1-bfa7-749df007565d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:04.391470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16907-8e3a-40c1-bfa7-749df007565d None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:04.393787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 650/1293] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:08:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:08:04.402661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8765c-8e1f-45d7-87f3-063dfaffe2e6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:04.403367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8765c-8e1f-45d7-87f3-063dfaffe2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:04.403699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8765c-8e1f-45d7-87f3-063dfaffe2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:04.423318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d1d8765c-8e1f-45d7-87f3-063dfaffe2e6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:04.424555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d1d8765c-8e1f-45d7-87f3-063dfaffe2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:04.456277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:04.498125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 644/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:08:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:08:04.521433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16907-8e3a-40c1-bfa7-749df007565d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:04.554889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:04.637346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16907-8e3a-40c1-bfa7-749df007565d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:04.677543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cb77a-134e-4b47-947d-3b541b4187e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:04.678217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb77a-134e-4b47-947d-3b541b4187e5 None admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:04.678509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb77a-134e-4b47-947d-3b541b4187e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:04.678789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb77a-134e-4b47-947d-3b541b4187e5 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:04.679517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb77a-134e-4b47-947d-3b541b4187e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:04.680956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb77a-134e-4b47-947d-3b541b4187e5 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:04.697533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 651/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 17:08:04 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:06.875648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a902f8e-94c6-4625-8eba-175d1c1fddd1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:06.876498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a902f8e-94c6-4625-8eba-175d1c1fddd1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:06.876498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a902f8e-94c6-4625-8eba-175d1c1fddd1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:06.878774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 645/1296] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:08:06.886932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:06.887454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:06.887568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:06.905758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:06.906936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:06.983151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 652/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:08:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:08:07.006110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a902f8e-94c6-4625-8eba-175d1c1fddd1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:07.114255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a902f8e-94c6-4625-8eba-175d1c1fddd1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:07.151800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:07.152639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:07.152975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:07.153209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] PATH_INFO: `/v3/services/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:07.153895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:07.155296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:08:07.167621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:08:07.168781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:07.169784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:07.172791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 646/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:08:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:08:07.175783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:07.197749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:07.280237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d953-b2be-4ff7-b8a9-a69fd3946837 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:07.315524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:07.316207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:07.316492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:07.316803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:07.317522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] RBAC: Adding query filter params (name=placement) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:07.317832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:07.319229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:07.324563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 653/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 17:08:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:07.331019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:07.366757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:07.440558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51622-f6c1-45a5-a30b-b947bcbda3af None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:07.474968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:07.475618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:07.475902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:07.476179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:07.477001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] RBAC: Adding query filter params (interface=public, service_id=4849fd2bf3334b0a8a09ee9a1b21fd4a, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:07.477316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:07.478712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b88013-f5b4-4807-aa89-b39842c43e30 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:07.484246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 647/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 17:08:07 2022] GET /identity/v3/endpoints?service_id=4849fd2bf3334b0a8a09ee9a1b21fd4a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:07.493622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:07.590368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:07.613610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359316d7-78fb-4f2f-94bc-d69f828756af None admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:07.654268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f46784-247e-4194-9887-364f7dba0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:07.654934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f46784-247e-4194-9887-364f7dba0711 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:07.655213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f46784-247e-4194-9887-364f7dba0711 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:07.655484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f46784-247e-4194-9887-364f7dba0711 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:07.656163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f46784-247e-4194-9887-364f7dba0711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:07.657592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f46784-247e-4194-9887-364f7dba0711 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:07.664397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 654/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 17:08:07 2022] GET /identity/v3/services => generated 2191 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:08:09.817295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdcc5f-c990-4dc1-99df-212960efbb1b None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:09.817795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdcc5f-c990-4dc1-99df-212960efbb1b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:09.817897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdcc5f-c990-4dc1-99df-212960efbb1b None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:09.819282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 648/1302] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:08:09.825545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae079aa-e297-47b4-a752-faa65333093a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:09.826021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae079aa-e297-47b4-a752-faa65333093a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:09.826160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae079aa-e297-47b4-a752-faa65333093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:09.844432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bae079aa-e297-47b4-a752-faa65333093a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:08:09.845648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bae079aa-e297-47b4-a752-faa65333093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:08:09.921481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 655/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:08:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:08:09.944528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdcc5f-c990-4dc1-99df-212960efbb1b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:10.051610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:10.060259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdcc5f-c990-4dc1-99df-212960efbb1b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:10.095625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:10.096553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:10.096941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:10.097223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:10.097879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:10.099279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:08:10.111665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:08:10.112938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 17:08:10.113866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 649/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 17:08:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:08:10.119190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae079aa-e297-47b4-a752-faa65333093a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:10.200329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:10.230615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae079aa-e297-47b4-a752-faa65333093a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:10.266630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:10.267296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:10.267577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:10.267844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] PATH_INFO: `/v3/services` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:10.268674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:08:10.268835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:10.270268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2458e7c-c9d3-416a-a241-c2a80db53481 None admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:10.275488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 656/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 17:08:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:08:10.282488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:08:10.390408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ea1d-300d-4b22-b05b-71865e5b8764 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:08:10.426043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b32ee-6aba-4e7f-9b8b-4d8d0fa7da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:08:10.426702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b32ee-6aba-4e7f-9b8b-4d8d0fa7da6b None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:08:10.427003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b32ee-6aba-4e7f-9b8b-4d8d0fa7da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:08:10.427269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b32ee-6aba-4e7f-9b8b-4d8d0fa7da6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:08:10.428011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b32ee-6aba-4e7f-9b8b-4d8d0fa7da6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:08:10.429429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b32ee-6aba-4e7f-9b8b-4d8d0fa7da6b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:08:10.453671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 650/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 17:08:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:08:20.272697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=30 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:08:20.447729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:14.304075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778cb94-ab2b-43fb-9971-6bb705769cf6 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.304702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778cb94-ab2b-43fb-9971-6bb705769cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.304702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778cb94-ab2b-43fb-9971-6bb705769cf6 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.306050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 657/1307] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:14.311521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85a42-1698-4d89-a1a4-48c739a16466 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.311994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85a42-1698-4d89-a1a4-48c739a16466 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.312078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85a42-1698-4d89-a1a4-48c739a16466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.395516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7ba85a42-1698-4d89-a1a4-48c739a16466 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:14.396851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7ba85a42-1698-4d89-a1a4-48c739a16466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.508776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 651/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:14.557730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15c0a-3b0b-4156-ad9c-030c79ce7ac1 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.558387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15c0a-3b0b-4156-ad9c-030c79ce7ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.559898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15c0a-3b0b-4156-ad9c-030c79ce7ac1 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.561986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 658/1309] 10.222.0.46 () {54 vars in 964 bytes} [Mon May 23 17:09:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:14.567660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8af7-425a-4d4a-bd3c-bcf422e3cfe6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.568074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8af7-425a-4d4a-bd3c-bcf422e3cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.568461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8af7-425a-4d4a-bd3c-bcf422e3cfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.669336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-386a8af7-425a-4d4a-bd3c-bcf422e3cfe6 None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:14.671065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-386a8af7-425a-4d4a-bd3c-bcf422e3cfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.699310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:14.772114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 652/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Mon May 23 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:14.780931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15c0a-3b0b-4156-ad9c-030c79ce7ac1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:14.782613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1ba15c0a-3b0b-4156-ad9c-030c79ce7ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:14.895668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15c0a-3b0b-4156-ad9c-030c79ce7ac1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:14.983988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:14.984873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:14.985363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:14.985784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:14.987607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:15.045173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:15.107847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:15.109373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9b97b-61f9-4855-a989-5c543c9ab0e5 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:15.129134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 659/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:17.635490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391153f-82e1-4f53-b436-d76174bda89f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:17.636035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391153f-82e1-4f53-b436-d76174bda89f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:17.636035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391153f-82e1-4f53-b436-d76174bda89f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:17.637581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 653/1312] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:17.643270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847274-cdb8-4d84-83da-9f6eb504a6b0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:17.643740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847274-cdb8-4d84-83da-9f6eb504a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:17.643822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847274-cdb8-4d84-83da-9f6eb504a6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:17.713261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-05847274-cdb8-4d84-83da-9f6eb504a6b0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:17.714477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-05847274-cdb8-4d84-83da-9f6eb504a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:17.820948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 660/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:17.872667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4869663-4825-4082-81f8-02577d1b8712 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:17.872865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4869663-4825-4082-81f8-02577d1b8712 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:17.873173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4869663-4825-4082-81f8-02577d1b8712 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:17.874729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 654/1314] 10.222.0.46 () {54 vars in 964 bytes} [Mon May 23 17:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:17.880618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fb9c-8757-40ae-8f8c-35e4b4e2f9a1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:17.880924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fb9c-8757-40ae-8f8c-35e4b4e2f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:17.881204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fb9c-8757-40ae-8f8c-35e4b4e2f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:17.892492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:17.957500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ac88fb9c-8757-40ae-8f8c-35e4b4e2f9a1 None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:17.958713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ac88fb9c-8757-40ae-8f8c-35e4b4e2f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:18.036448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 661/1315] 10.222.0.46 () {58 vars in 1061 bytes} [Mon May 23 17:09:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:18.045550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4869663-4825-4082-81f8-02577d1b8712 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:18.047167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c4869663-4825-4082-81f8-02577d1b8712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:18.154240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4869663-4825-4082-81f8-02577d1b8712 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:18.227780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:18.230684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:18.231387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:18.231686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:18.231972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:18.234327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:18.349379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:18.350865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5bf32-34d5-4479-bed5-636cd1f666ae service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:18.369908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 655/1316] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:09:21.078358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074178b1-ab72-492c-b347-f83a55ac2081 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.078921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074178b1-ab72-492c-b347-f83a55ac2081 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.078921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074178b1-ab72-492c-b347-f83a55ac2081 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:21.080206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 662/1317] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:21.085587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe0ae-3c73-4716-b7ba-35061f929e2a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.086014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe0ae-3c73-4716-b7ba-35061f929e2a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.086517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe0ae-3c73-4716-b7ba-35061f929e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:21.154124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-affbe0ae-3c73-4716-b7ba-35061f929e2a None None] MFA Rules not processed for user `6a828f4d2cba4ce2bf3d1520397c11ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:21.155375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-affbe0ae-3c73-4716-b7ba-35061f929e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:21.212822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:21.258552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 656/1318] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:21.298951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074178b1-ab72-492c-b347-f83a55ac2081 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:21.300705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-074178b1-ab72-492c-b347-f83a55ac2081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:21.409563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074178b1-ab72-492c-b347-f83a55ac2081 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:21.412344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:21.487319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:21.488015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:21.488293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:21.488569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:21.490226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:21.609747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:21.611271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283f9c-f04e-4d39-bcd6-27f3bd18d6f5 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:21.629409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 663/1319] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:24.413275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11449edb-fd4b-416d-8cb8-b24cb68357a5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.413862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11449edb-fd4b-416d-8cb8-b24cb68357a5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.413862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11449edb-fd4b-416d-8cb8-b24cb68357a5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:24.415207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 657/1320] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:24.421738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ceff2-fb06-400f-959c-4492637ec0f6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.422181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ceff2-fb06-400f-959c-4492637ec0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.422356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ceff2-fb06-400f-959c-4492637ec0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:24.467863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:24.500444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bf5ceff2-fb06-400f-959c-4492637ec0f6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:24.501724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bf5ceff2-fb06-400f-959c-4492637ec0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:24.614067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 664/1321] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:24.653004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11449edb-fd4b-416d-8cb8-b24cb68357a5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:24.654545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-11449edb-fd4b-416d-8cb8-b24cb68357a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:24.781757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11449edb-fd4b-416d-8cb8-b24cb68357a5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:24.861748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:24.862415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:24.862702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:24.862979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:24.864636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:24.872237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:24.983049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:24.984519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a32e9-12e4-4f71-97cd-46c8e8854b58 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:25.004184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 658/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:27.854392 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42779b-7b47-46c2-9068-1997ea8cf7d2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:27.854949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42779b-7b47-46c2-9068-1997ea8cf7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:27.854949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42779b-7b47-46c2-9068-1997ea8cf7d2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:27.856404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 665/1323] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:27.861953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb2d32-6630-4cd6-8a30-cec32f7912b9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:27.862379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb2d32-6630-4cd6-8a30-cec32f7912b9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:27.862493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb2d32-6630-4cd6-8a30-cec32f7912b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:27.926916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c9bb2d32-6630-4cd6-8a30-cec32f7912b9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:27.928152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c9bb2d32-6630-4cd6-8a30-cec32f7912b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:27.986550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:28.036736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 659/1324] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:28.073198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42779b-7b47-46c2-9068-1997ea8cf7d2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:28.073198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0e42779b-7b47-46c2-9068-1997ea8cf7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:28.189769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42779b-7b47-46c2-9068-1997ea8cf7d2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:28.202566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:28.268452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:28.269096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:28.269378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:28.269656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:28.271282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:28.381090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:28.382512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03975-e0e2-41e4-9aeb-fc2bcd366b84 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:28.402000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 666/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:30.633108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c507-7c8b-489f-8327-e3d1d58b874e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:30.633674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c507-7c8b-489f-8327-e3d1d58b874e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:30.633674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c507-7c8b-489f-8327-e3d1d58b874e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:30.635019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 660/1326] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:30.640810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60fb8e-39dc-4267-9041-85aa800efca2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:30.641250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60fb8e-39dc-4267-9041-85aa800efca2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:30.641371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60fb8e-39dc-4267-9041-85aa800efca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:30.692937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:30.712234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bf60fb8e-39dc-4267-9041-85aa800efca2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:30.713496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bf60fb8e-39dc-4267-9041-85aa800efca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:30.816036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 667/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:30.850825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c507-7c8b-489f-8327-e3d1d58b874e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:30.852486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5ac9c507-7c8b-489f-8327-e3d1d58b874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:30.969493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c507-7c8b-489f-8327-e3d1d58b874e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:31.046090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:31.046756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:31.047043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:31.047324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:31.049098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:31.065977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:31.164423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:31.165931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2aaf3-f941-43b7-a829-8d7ee9482154 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:31.184811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 661/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:33.440958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7051b4-3460-4ae2-be58-ddd5b3aa98f0 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.441531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7051b4-3460-4ae2-be58-ddd5b3aa98f0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.441531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7051b4-3460-4ae2-be58-ddd5b3aa98f0 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.442883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 668/1329] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:33.448201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5653d0-3beb-4f38-a28f-36ad08dd95a6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.448679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5653d0-3beb-4f38-a28f-36ad08dd95a6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.448890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5653d0-3beb-4f38-a28f-36ad08dd95a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.515551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6a5653d0-3beb-4f38-a28f-36ad08dd95a6 None None] MFA Rules not processed for user `6a828f4d2cba4ce2bf3d1520397c11ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:33.516798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6a5653d0-3beb-4f38-a28f-36ad08dd95a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.586850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:33.619739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 662/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:33.658717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7051b4-3460-4ae2-be58-ddd5b3aa98f0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:33.660283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-db7051b4-3460-4ae2-be58-ddd5b3aa98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.770562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7051b4-3460-4ae2-be58-ddd5b3aa98f0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:33.791430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:33.848712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:33.849388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:33.849663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:33.849928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:33.851587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:33.962415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:33.963883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74997f17-5b2b-464a-bed9-84955c936bca service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:33.982119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 669/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:36.424042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a7ec-3069-40c2-a312-98ed3001ad87 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.424650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a7ec-3069-40c2-a312-98ed3001ad87 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.424650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a7ec-3069-40c2-a312-98ed3001ad87 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.426050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 663/1332] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:36.432592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da4286-e10a-4ebe-bf01-14a645f2ba0e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.433839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da4286-e10a-4ebe-bf01-14a645f2ba0e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.434148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da4286-e10a-4ebe-bf01-14a645f2ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.505923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:36.508757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-58da4286-e10a-4ebe-bf01-14a645f2ba0e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:36.510827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-58da4286-e10a-4ebe-bf01-14a645f2ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:36.611558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 670/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:36.647236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a7ec-3069-40c2-a312-98ed3001ad87 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:36.648813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5ea9a7ec-3069-40c2-a312-98ed3001ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:36.763584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a7ec-3069-40c2-a312-98ed3001ad87 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:36.847471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:36.848147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:36.848440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:36.848760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:36.850434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:36.878327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:36.961611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:36.963086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9edac-be8c-4230-bae2-c542f3258508 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:36.982756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 664/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:39.215661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774b97b-fd06-46fa-a84d-d0d956aa50b5 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:39.216544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774b97b-fd06-46fa-a84d-d0d956aa50b5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:39.216544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774b97b-fd06-46fa-a84d-d0d956aa50b5 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.218768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 671/1335] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:39.225145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed58c2-996d-4d02-994a-beaa9138c0af None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:39.225626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed58c2-996d-4d02-994a-beaa9138c0af None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:39.225720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed58c2-996d-4d02-994a-beaa9138c0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.292760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6aed58c2-996d-4d02-994a-beaa9138c0af None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:39.293992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6aed58c2-996d-4d02-994a-beaa9138c0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:39.376851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:39.401318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 665/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:39.444231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774b97b-fd06-46fa-a84d-d0d956aa50b5 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:39.446699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1774b97b-fd06-46fa-a84d-d0d956aa50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:39.561284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774b97b-fd06-46fa-a84d-d0d956aa50b5 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:39.590367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:39.650162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:39.650824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:39.651112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:39.651376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:39.653192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:39.767912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:39.769415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6eb875-d298-49dd-85bd-ff44646204e8 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:39.788372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 672/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:42.335035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6745f0-5477-4f6e-8365-7cf5fd8cbfa4 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:42.335642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6745f0-5477-4f6e-8365-7cf5fd8cbfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:42.335642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6745f0-5477-4f6e-8365-7cf5fd8cbfa4 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:42.336916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 666/1338] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:42.344703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722b44e-c998-4755-b8b6-93016119c06e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:42.345527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722b44e-c998-4755-b8b6-93016119c06e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:42.346355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722b44e-c998-4755-b8b6-93016119c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:42.429565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7722b44e-c998-4755-b8b6-93016119c06e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:42.430785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7722b44e-c998-4755-b8b6-93016119c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:42.439330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:42.536621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 673/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:42.581036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6745f0-5477-4f6e-8365-7cf5fd8cbfa4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:42.582798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ea6745f0-5477-4f6e-8365-7cf5fd8cbfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:42.697837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6745f0-5477-4f6e-8365-7cf5fd8cbfa4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:42.780197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:42.780880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:42.781163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:42.781444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:42.783089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:42.820921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:42.912255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:42.914513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d231e-f69b-49ce-9361-4266592e51d9 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:42.935224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 667/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:47.484133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98397b41-aa51-46aa-a87a-be92ad917f1b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.484750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98397b41-aa51-46aa-a87a-be92ad917f1b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.484750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98397b41-aa51-46aa-a87a-be92ad917f1b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.487862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 674/1341] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:47.492305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849de2df-ccd4-4474-94f3-e63a9e83fbae None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.492801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849de2df-ccd4-4474-94f3-e63a9e83fbae None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.492900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849de2df-ccd4-4474-94f3-e63a9e83fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.567158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-849de2df-ccd4-4474-94f3-e63a9e83fbae None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:47.568290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-849de2df-ccd4-4474-94f3-e63a9e83fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.665236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:47.680448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 668/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:47.719497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98397b41-aa51-46aa-a87a-be92ad917f1b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:47.721772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-98397b41-aa51-46aa-a87a-be92ad917f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:47.821940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98397b41-aa51-46aa-a87a-be92ad917f1b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:47.825624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2273e6e-7c64-4ac6-8423-76f32cb22a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:47.826283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273e6e-7c64-4ac6-8423-76f32cb22a5f service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:47.826565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273e6e-7c64-4ac6-8423-76f32cb22a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:47.826839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273e6e-7c64-4ac6-8423-76f32cb22a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:47.836010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2273e6e-7c64-4ac6-8423-76f32cb22a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:47.837494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2273e6e-7c64-4ac6-8423-76f32cb22a5f service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:47.847019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 675/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:50.624832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5242b8-4c34-4465-bbf2-c8fc8819f46f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.625357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5242b8-4c34-4465-bbf2-c8fc8819f46f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.625357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5242b8-4c34-4465-bbf2-c8fc8819f46f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.626895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 669/1344] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:50.633116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48034a-f558-45c8-bbf7-6b6c44536abd None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.633524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48034a-f558-45c8-bbf7-6b6c44536abd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.633850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48034a-f558-45c8-bbf7-6b6c44536abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.663565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7a48034a-f558-45c8-bbf7-6b6c44536abd None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:50.664834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7a48034a-f558-45c8-bbf7-6b6c44536abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:50.696212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:09:50.749524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 676/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:50.786575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5242b8-4c34-4465-bbf2-c8fc8819f46f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:50.799228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5242b8-4c34-4465-bbf2-c8fc8819f46f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:50.803467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c9cfa-3e5a-4bf4-95fa-298b5143039b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:50.804129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c9cfa-3e5a-4bf4-95fa-298b5143039b service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:50.804417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c9cfa-3e5a-4bf4-95fa-298b5143039b service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:50.804728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c9cfa-3e5a-4bf4-95fa-298b5143039b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:50.814176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c9cfa-3e5a-4bf4-95fa-298b5143039b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:50.815631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c9cfa-3e5a-4bf4-95fa-298b5143039b service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:50.825231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 670/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:09:55.236171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038ebe-fdd6-40d4-89f0-efa3201f3905 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:55.236787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038ebe-fdd6-40d4-89f0-efa3201f3905 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:55.236787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038ebe-fdd6-40d4-89f0-efa3201f3905 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:55.238182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 677/1347] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:09:55.243699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b59f-8d03-4100-b548-237edd6b3c29 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:55.244121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b59f-8d03-4100-b548-237edd6b3c29 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:55.244266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b59f-8d03-4100-b548-237edd6b3c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:55.263912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ce24b59f-8d03-4100-b548-237edd6b3c29 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:09:55.265518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce24b59f-8d03-4100-b548-237edd6b3c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:55.276124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 671/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:09:55.313551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038ebe-fdd6-40d4-89f0-efa3201f3905 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:09:55.315477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-44038ebe-fdd6-40d4-89f0-efa3201f3905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:09:55.329999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038ebe-fdd6-40d4-89f0-efa3201f3905 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:09:55.333644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a2a7b-857c-4bc8-80b4-17ad697d7a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:09:55.334297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a2a7b-857c-4bc8-80b4-17ad697d7a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:09:55.334579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a2a7b-857c-4bc8-80b4-17ad697d7a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:09:55.334854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a2a7b-857c-4bc8-80b4-17ad697d7a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:09:55.343881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a2a7b-857c-4bc8-80b4-17ad697d7a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:09:55.345362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a2a7b-857c-4bc8-80b4-17ad697d7a76 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:09:55.354694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 678/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:00.652129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771cf34-6ce8-4b33-8b00-fa125f72f323 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.652642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771cf34-6ce8-4b33-8b00-fa125f72f323 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.652642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771cf34-6ce8-4b33-8b00-fa125f72f323 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.654310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 672/1350] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:00.659807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583cb2-6e36-4fa9-8d1d-25730e7404d7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:00.660667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583cb2-6e36-4fa9-8d1d-25730e7404d7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:00.660913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583cb2-6e36-4fa9-8d1d-25730e7404d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:00.729509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-32583cb2-6e36-4fa9-8d1d-25730e7404d7 None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:00.731118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-32583cb2-6e36-4fa9-8d1d-25730e7404d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:00.805314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 679/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:05.034517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac206be-a445-451b-9d4c-07acf2f403f1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:05.035410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac206be-a445-451b-9d4c-07acf2f403f1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:05.035672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac206be-a445-451b-9d4c-07acf2f403f1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:05.037230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 673/1352] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:05.047902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1627-a8c6-47a0-a8d3-646d918e3268 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:05.048437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1627-a8c6-47a0-a8d3-646d918e3268 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:05.048437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1627-a8c6-47a0-a8d3-646d918e3268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:05.068176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-188c1627-a8c6-47a0-a8d3-646d918e3268 None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:05.069710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-188c1627-a8c6-47a0-a8d3-646d918e3268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:05.080138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 680/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:10:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:05.257486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=13 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:06.634580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddedaf0-25ef-4492-be13-8b1c82cbd352 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:06.635276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddedaf0-25ef-4492-be13-8b1c82cbd352 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:06.635276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddedaf0-25ef-4492-be13-8b1c82cbd352 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:06.636789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 674/1354] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:06.642402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9b6c-e57e-4e0c-bf87-112f5e2a6fdf None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:06.642831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9b6c-e57e-4e0c-bf87-112f5e2a6fdf None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:06.642955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9b6c-e57e-4e0c-bf87-112f5e2a6fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:06.662368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c88e9b6c-e57e-4e0c-bf87-112f5e2a6fdf None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:06.663575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c88e9b6c-e57e-4e0c-bf87-112f5e2a6fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:06.673140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 681/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:10:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:10.540779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f252-ebdb-4bf2-abd7-b605e92c0e8e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.541381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f252-ebdb-4bf2-abd7-b605e92c0e8e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.541540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f252-ebdb-4bf2-abd7-b605e92c0e8e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.543124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 675/1356] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:10.548746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6123602-f7b3-4a47-a935-eb36a4b83d37 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.549177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6123602-f7b3-4a47-a935-eb36a4b83d37 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.549592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6123602-f7b3-4a47-a935-eb36a4b83d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.568088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d6123602-f7b3-4a47-a935-eb36a4b83d37 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:10.569322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d6123602-f7b3-4a47-a935-eb36a4b83d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:10.577492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 682/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:10.629761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d808f-cd82-4fd9-9ecb-b1d3f67d02f5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.630241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d808f-cd82-4fd9-9ecb-b1d3f67d02f5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.630678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d808f-cd82-4fd9-9ecb-b1d3f67d02f5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.632452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 676/1358] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 17:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:10.647273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b4c8-150c-49f8-9664-7098d2a9c07e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.647752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b4c8-150c-49f8-9664-7098d2a9c07e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.648200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b4c8-150c-49f8-9664-7098d2a9c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.695794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:10.700154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-38c9b4c8-150c-49f8-9664-7098d2a9c07e None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:10.702356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-38c9b4c8-150c-49f8-9664-7098d2a9c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:10.790376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 683/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:10.798471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d808f-cd82-4fd9-9ecb-b1d3f67d02f5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:10.815517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d808f-cd82-4fd9-9ecb-b1d3f67d02f5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:10.821650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d909b3a-f385-4e29-b169-796198d5e63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:10.821968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d909b3a-f385-4e29-b169-796198d5e63f service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:10.822499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d909b3a-f385-4e29-b169-796198d5e63f service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:10.822837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d909b3a-f385-4e29-b169-796198d5e63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:10.832413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d909b3a-f385-4e29-b169-796198d5e63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:10.834147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d909b3a-f385-4e29-b169-796198d5e63f service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:10.844038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 677/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:13.279099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5913-2ba7-46f8-aa13-b744aa79d118 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.279674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5913-2ba7-46f8-aa13-b744aa79d118 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.279674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5913-2ba7-46f8-aa13-b744aa79d118 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.281013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 684/1361] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:13.286783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8748c3-fb0f-46f8-a729-f2222ee6375d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.287298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8748c3-fb0f-46f8-a729-f2222ee6375d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.287515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8748c3-fb0f-46f8-a729-f2222ee6375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.307048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2e8748c3-fb0f-46f8-a729-f2222ee6375d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:13.308442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2e8748c3-fb0f-46f8-a729-f2222ee6375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:13.318482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 678/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:13.363534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5913-2ba7-46f8-aa13-b744aa79d118 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:13.378787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5913-2ba7-46f8-aa13-b744aa79d118 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:13.384492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a8311-3e01-476e-83c0-c893837e018c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:13.385191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8311-3e01-476e-83c0-c893837e018c service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:13.385527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8311-3e01-476e-83c0-c893837e018c service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:13.385841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8311-3e01-476e-83c0-c893837e018c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:13.394808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a8311-3e01-476e-83c0-c893837e018c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:13.396430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a8311-3e01-476e-83c0-c893837e018c service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:13.406377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 685/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:15.903780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc872-a052-44f8-8a60-28e8925c6d36 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.904349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc872-a052-44f8-8a60-28e8925c6d36 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.904349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc872-a052-44f8-8a60-28e8925c6d36 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.906036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 679/1364] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:15.912093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9aee4-251b-430a-ad95-c9c666df07c0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.912540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9aee4-251b-430a-ad95-c9c666df07c0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.912707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9aee4-251b-430a-ad95-c9c666df07c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.932816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-62c9aee4-251b-430a-ad95-c9c666df07c0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:15.934024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-62c9aee4-251b-430a-ad95-c9c666df07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:15.942461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 686/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:15.991465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df8df-66f2-4f47-af21-d0996190e2c2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.991756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df8df-66f2-4f47-af21-d0996190e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.992041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df8df-66f2-4f47-af21-d0996190e2c2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:15.993460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 680/1366] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 17:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:15.998818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db35ca7-66a3-45a4-b363-21d542a8f362 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:15.999111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db35ca7-66a3-45a4-b363-21d542a8f362 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:15.999420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db35ca7-66a3-45a4-b363-21d542a8f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:16.031193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7db35ca7-66a3-45a4-b363-21d542a8f362 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:16.031193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7db35ca7-66a3-45a4-b363-21d542a8f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:16.042202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 687/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:16.052774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df8df-66f2-4f47-af21-d0996190e2c2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:16.074796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df8df-66f2-4f47-af21-d0996190e2c2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:16.080427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6036359-fb86-488e-9d86-4d4358781483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:16.081156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6036359-fb86-488e-9d86-4d4358781483 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:16.081448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6036359-fb86-488e-9d86-4d4358781483 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:16.081727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6036359-fb86-488e-9d86-4d4358781483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:16.090560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6036359-fb86-488e-9d86-4d4358781483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:16.092202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6036359-fb86-488e-9d86-4d4358781483 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:16.102188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 681/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:18.374733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58859-b2c0-46d3-9221-7063003c43ea None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:18.375260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58859-b2c0-46d3-9221-7063003c43ea None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:18.375570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58859-b2c0-46d3-9221-7063003c43ea None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:18.377415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 688/1369] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:18.383706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a09d-8569-4ab8-9ad1-fc769450a676 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:18.384206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a09d-8569-4ab8-9ad1-fc769450a676 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:18.384291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a09d-8569-4ab8-9ad1-fc769450a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:18.403361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f578a09d-8569-4ab8-9ad1-fc769450a676 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:18.404568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f578a09d-8569-4ab8-9ad1-fc769450a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:18.412955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 682/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:18.456577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd58859-b2c0-46d3-9221-7063003c43ea None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:18.472002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd58859-b2c0-46d3-9221-7063003c43ea None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:18.477607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fe2c5-c700-475f-89b3-6337d5924f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:18.478262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fe2c5-c700-475f-89b3-6337d5924f8c service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:18.478550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fe2c5-c700-475f-89b3-6337d5924f8c service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:18.478828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fe2c5-c700-475f-89b3-6337d5924f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:18.487627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fe2c5-c700-475f-89b3-6337d5924f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:18.489343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fe2c5-c700-475f-89b3-6337d5924f8c service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:18.499973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 689/1371] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:18.718030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10f67-6804-4d4a-b192-5e5f1fd10aee None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:18.718324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10f67-6804-4d4a-b192-5e5f1fd10aee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:18.718844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10f67-6804-4d4a-b192-5e5f1fd10aee None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:18.721515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 683/1372] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:18.726537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613475a-afcb-4feb-a9b5-07be6a9fbafb None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:18.726801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613475a-afcb-4feb-a9b5-07be6a9fbafb None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:18.727281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613475a-afcb-4feb-a9b5-07be6a9fbafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:18.753142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-5613475a-afcb-4feb-a9b5-07be6a9fbafb None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:18.754399 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5613475a-afcb-4feb-a9b5-07be6a9fbafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:18.763361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 690/1373] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:19.086280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3010-d6da-4479-aeb3-58cc4a180845 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:19.086795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3010-d6da-4479-aeb3-58cc4a180845 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:19.087226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3010-d6da-4479-aeb3-58cc4a180845 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:19.088832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 684/1374] 10.222.0.46 () {54 vars in 963 bytes} [Mon May 23 17:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:19.095348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c0bb-29df-4ee5-bfbd-3bb6169a5bfa None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:19.095880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c0bb-29df-4ee5-bfbd-3bb6169a5bfa None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:19.096316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c0bb-29df-4ee5-bfbd-3bb6169a5bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:19.146354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a137c0bb-29df-4ee5-bfbd-3bb6169a5bfa None None] MFA Rules not processed for user `d7460f33e2f74a1e86b76eab550b7c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:19.147808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a137c0bb-29df-4ee5-bfbd-3bb6169a5bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:19.211732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 691/1375] 10.222.0.46 () {58 vars in 1060 bytes} [Mon May 23 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:19.219685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3010-d6da-4479-aeb3-58cc4a180845 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:19.230644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3010-d6da-4479-aeb3-58cc4a180845 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:19.234377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba260f4c-5922-4045-be1d-5a77e76e5b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:19.235191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260f4c-5922-4045-be1d-5a77e76e5b7d service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:19.235620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260f4c-5922-4045-be1d-5a77e76e5b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:19.236062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260f4c-5922-4045-be1d-5a77e76e5b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:19.245817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba260f4c-5922-4045-be1d-5a77e76e5b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:19.247455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba260f4c-5922-4045-be1d-5a77e76e5b7d service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:19.257452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 685/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:10:20.774344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5ee85-2fb1-42df-b781-1f7eafb5d8e8 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:20.774971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5ee85-2fb1-42df-b781-1f7eafb5d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:20.774971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5ee85-2fb1-42df-b781-1f7eafb5d8e8 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:20.776496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 692/1377] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:20.782789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af8ff6-527d-422f-8a1e-4c71fe667515 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:20.783354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af8ff6-527d-422f-8a1e-4c71fe667515 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:20.783500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af8ff6-527d-422f-8a1e-4c71fe667515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:20.803762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-19af8ff6-527d-422f-8a1e-4c71fe667515 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:20.805065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-19af8ff6-527d-422f-8a1e-4c71fe667515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:20.813500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 686/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:20.859109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5ee85-2fb1-42df-b781-1f7eafb5d8e8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:20.874357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5ee85-2fb1-42df-b781-1f7eafb5d8e8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:20.880851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be804d6-8c40-4791-b841-4c78aee208e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:20.881535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be804d6-8c40-4791-b841-4c78aee208e7 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:20.881856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be804d6-8c40-4791-b841-4c78aee208e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:20.882138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be804d6-8c40-4791-b841-4c78aee208e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:20.892211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be804d6-8c40-4791-b841-4c78aee208e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:20.893894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be804d6-8c40-4791-b841-4c78aee208e7 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:20.898295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:20.906236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 693/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:23.147201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeb3cf-61fe-4640-9c87-a5e108bb2c78 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:23.147754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeb3cf-61fe-4640-9c87-a5e108bb2c78 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:23.147754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeb3cf-61fe-4640-9c87-a5e108bb2c78 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:23.149419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 687/1380] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:23.154966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488700c-a3a5-4bae-9514-e4dcc36413f6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:23.155425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488700c-a3a5-4bae-9514-e4dcc36413f6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:23.155582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488700c-a3a5-4bae-9514-e4dcc36413f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:23.179716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c488700c-a3a5-4bae-9514-e4dcc36413f6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:23.182889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c488700c-a3a5-4bae-9514-e4dcc36413f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:23.194472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 694/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:23.250250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeb3cf-61fe-4640-9c87-a5e108bb2c78 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:23.265531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeb3cf-61fe-4640-9c87-a5e108bb2c78 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:23.271096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2ed4b-4a87-42d9-b756-cbed61d42c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:23.271750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2ed4b-4a87-42d9-b756-cbed61d42c66 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:23.272040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2ed4b-4a87-42d9-b756-cbed61d42c66 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:23.272324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2ed4b-4a87-42d9-b756-cbed61d42c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:23.281103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2ed4b-4a87-42d9-b756-cbed61d42c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:23.282698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2ed4b-4a87-42d9-b756-cbed61d42c66 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:23.292693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 688/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:25.518440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df0d62-82f2-4480-84c8-62f74d950ba6 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:25.518987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df0d62-82f2-4480-84c8-62f74d950ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:25.519139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df0d62-82f2-4480-84c8-62f74d950ba6 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:25.520822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 695/1383] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:25.526376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89dd9-d318-49a8-a54d-c63b669b804b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:25.526870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89dd9-d318-49a8-a54d-c63b669b804b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:25.527378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89dd9-d318-49a8-a54d-c63b669b804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:25.551048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b1b89dd9-d318-49a8-a54d-c63b669b804b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:25.552699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b1b89dd9-d318-49a8-a54d-c63b669b804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:25.563047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 689/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:25.610234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df0d62-82f2-4480-84c8-62f74d950ba6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:25.625378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df0d62-82f2-4480-84c8-62f74d950ba6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:25.631697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a1e55-44e0-43b0-a8b8-78ea6afeab1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:25.632477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a1e55-44e0-43b0-a8b8-78ea6afeab1c service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:25.632916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a1e55-44e0-43b0-a8b8-78ea6afeab1c service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:25.633290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a1e55-44e0-43b0-a8b8-78ea6afeab1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:25.643523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a1e55-44e0-43b0-a8b8-78ea6afeab1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:25.645682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a1e55-44e0-43b0-a8b8-78ea6afeab1c service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:25.657445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 696/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:27.868053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a716c-4eb0-4151-a63d-c0d4b6f6250f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:27.868691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a716c-4eb0-4151-a63d-c0d4b6f6250f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:27.868691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a716c-4eb0-4151-a63d-c0d4b6f6250f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:27.870129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 690/1386] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:27.875560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377f659-8fe1-4f38-9d76-9e8e9649d630 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:27.875972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377f659-8fe1-4f38-9d76-9e8e9649d630 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:27.876124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377f659-8fe1-4f38-9d76-9e8e9649d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:27.896075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c377f659-8fe1-4f38-9d76-9e8e9649d630 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:27.897331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c377f659-8fe1-4f38-9d76-9e8e9649d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:27.905066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 697/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:27.949774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a716c-4eb0-4151-a63d-c0d4b6f6250f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:27.964721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a716c-4eb0-4151-a63d-c0d4b6f6250f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:27.970429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b91e6-5302-4b2f-8d1f-4ff79eb3a0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:27.971126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b91e6-5302-4b2f-8d1f-4ff79eb3a0be service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:27.971422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b91e6-5302-4b2f-8d1f-4ff79eb3a0be service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:27.971714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b91e6-5302-4b2f-8d1f-4ff79eb3a0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:27.980369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b91e6-5302-4b2f-8d1f-4ff79eb3a0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:27.982037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b91e6-5302-4b2f-8d1f-4ff79eb3a0be service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:27.991939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 691/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:30.710769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06171d36-7b0a-4210-ae58-db7c25b8ebe6 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:30.711856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06171d36-7b0a-4210-ae58-db7c25b8ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:30.712194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06171d36-7b0a-4210-ae58-db7c25b8ebe6 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:30.713900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 698/1389] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:10:30.719506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cf5b6-5482-4a9f-92cb-8bb47f5f722b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:30.720091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cf5b6-5482-4a9f-92cb-8bb47f5f722b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:30.720091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cf5b6-5482-4a9f-92cb-8bb47f5f722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:30.738895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cb7cf5b6-5482-4a9f-92cb-8bb47f5f722b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:30.740144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cb7cf5b6-5482-4a9f-92cb-8bb47f5f722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:30.748135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 692/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:30.796312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06171d36-7b0a-4210-ae58-db7c25b8ebe6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:30.812884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06171d36-7b0a-4210-ae58-db7c25b8ebe6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:30.818931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267d18b-bbb9-43f3-b16f-744479a56c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:30.819605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267d18b-bbb9-43f3-b16f-744479a56c00 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:30.819903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267d18b-bbb9-43f3-b16f-744479a56c00 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:30.820191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267d18b-bbb9-43f3-b16f-744479a56c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:30.829461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267d18b-bbb9-43f3-b16f-744479a56c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:30.831117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267d18b-bbb9-43f3-b16f-744479a56c00 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:30.841327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 699/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:33.601487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42a1c-a0bf-4497-9600-52184ff1fe3a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:33.602141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42a1c-a0bf-4497-9600-52184ff1fe3a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:33.602141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42a1c-a0bf-4497-9600-52184ff1fe3a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:33.603438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 693/1392] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:33.608833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c7b2-62c9-4d47-933f-759611be4f43 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:33.609415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c7b2-62c9-4d47-933f-759611be4f43 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:33.609415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c7b2-62c9-4d47-933f-759611be4f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:33.627776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-cef9c7b2-62c9-4d47-933f-759611be4f43 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:33.629002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-cef9c7b2-62c9-4d47-933f-759611be4f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:33.637187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 700/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:33.681254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42a1c-a0bf-4497-9600-52184ff1fe3a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:33.695972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42a1c-a0bf-4497-9600-52184ff1fe3a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:33.702215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79872-2cad-4532-a314-9cbd5b6c8585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:33.703081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79872-2cad-4532-a314-9cbd5b6c8585 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:33.703374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79872-2cad-4532-a314-9cbd5b6c8585 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:33.703656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79872-2cad-4532-a314-9cbd5b6c8585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:33.712449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf79872-2cad-4532-a314-9cbd5b6c8585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:33.714210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf79872-2cad-4532-a314-9cbd5b6c8585 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:33.725718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 694/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:34.825620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a951152-a58a-499c-ad95-a6a174cbab70 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:34.826170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a951152-a58a-499c-ad95-a6a174cbab70 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:34.826170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a951152-a58a-499c-ad95-a6a174cbab70 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:34.827588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 701/1395] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:34.833066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9264-c65d-4173-ba14-e716b611cb19 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:34.833504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9264-c65d-4173-ba14-e716b611cb19 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:34.833620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9264-c65d-4173-ba14-e716b611cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:34.852135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dc2c9264-c65d-4173-ba14-e716b611cb19 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:34.853633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dc2c9264-c65d-4173-ba14-e716b611cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:34.862183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 695/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:34.917034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dece0e3-c5f8-4ac5-aee9-6f2bc84ffb98 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:34.917403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dece0e3-c5f8-4ac5-aee9-6f2bc84ffb98 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:34.917746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dece0e3-c5f8-4ac5-aee9-6f2bc84ffb98 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:34.919138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 702/1397] 10.222.0.46 () {54 vars in 962 bytes} [Mon May 23 17:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:34.924281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d9bd9-f668-4aa9-8ef8-bf0eb2134cc8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:34.924554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d9bd9-f668-4aa9-8ef8-bf0eb2134cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:34.924870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d9bd9-f668-4aa9-8ef8-bf0eb2134cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:34.975776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-889d9bd9-f668-4aa9-8ef8-bf0eb2134cc8 None None] MFA Rules not processed for user `49486e8648f34ebf82979c60ab45ff6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:34.977026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-889d9bd9-f668-4aa9-8ef8-bf0eb2134cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:35.037918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 696/1398] 10.222.0.46 () {58 vars in 1059 bytes} [Mon May 23 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:35.045815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dece0e3-c5f8-4ac5-aee9-6f2bc84ffb98 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:35.057017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dece0e3-c5f8-4ac5-aee9-6f2bc84ffb98 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:35.060736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1262e6-86a1-4d4d-92c7-07109b5e2f66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:35.061385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1262e6-86a1-4d4d-92c7-07109b5e2f66 service glance] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.061670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1262e6-86a1-4d4d-92c7-07109b5e2f66 service glance] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.061949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1262e6-86a1-4d4d-92c7-07109b5e2f66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:35.070980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1262e6-86a1-4d4d-92c7-07109b5e2f66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:35.072426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1262e6-86a1-4d4d-92c7-07109b5e2f66 service glance] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:35.081806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 703/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:35.611580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8889-1d70-436b-a43f-6a3c2abf07da None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.611892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8889-1d70-436b-a43f-6a3c2abf07da None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.612161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8889-1d70-436b-a43f-6a3c2abf07da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:35.617629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:35.663174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-983b8889-1d70-436b-a43f-6a3c2abf07da None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:35.664381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-983b8889-1d70-436b-a43f-6a3c2abf07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:35.734606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 697/1400] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:35.777978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a756-487b-4c8f-a1f1-891262d28355 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.778275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a756-487b-4c8f-a1f1-891262d28355 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.778585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a756-487b-4c8f-a1f1-891262d28355 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:35.780075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 704/1401] 10.222.0.46 () {54 vars in 942 bytes} [Mon May 23 17:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:35.787547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5dd7d-0a83-4761-9695-baf5fd53bcba None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.787925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5dd7d-0a83-4761-9695-baf5fd53bcba None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.788277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5dd7d-0a83-4761-9695-baf5fd53bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:35.843919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0ba5dd7d-0a83-4761-9695-baf5fd53bcba None None] MFA Rules not processed for user `8a4c03a473c84329a4d982ef47ea0e52`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:35.845229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0ba5dd7d-0a83-4761-9695-baf5fd53bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:35.918242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 698/1402] 10.222.0.46 () {58 vars in 1039 bytes} [Mon May 23 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:10:35.927707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a756-487b-4c8f-a1f1-891262d28355 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:35.942289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a756-487b-4c8f-a1f1-891262d28355 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:35.947672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d320c17-8c28-4ec6-8a91-00eb87daa9bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:35.948388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320c17-8c28-4ec6-8a91-00eb87daa9bf service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.948730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320c17-8c28-4ec6-8a91-00eb87daa9bf service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.949010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320c17-8c28-4ec6-8a91-00eb87daa9bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:35.957293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d320c17-8c28-4ec6-8a91-00eb87daa9bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:35.958894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d320c17-8c28-4ec6-8a91-00eb87daa9bf service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:35.967249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 705/1403] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:10:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:10:35.984469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850bdab-374f-4e02-a0bb-6271e98d99f3 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.984793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850bdab-374f-4e02-a0bb-6271e98d99f3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.985231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850bdab-374f-4e02-a0bb-6271e98d99f3 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:35.986591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 699/1404] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:35.992257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e3ee-9d91-4bae-9dac-7c81d27fe286 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:35.992554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e3ee-9d91-4bae-9dac-7c81d27fe286 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:35.992877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e3ee-9d91-4bae-9dac-7c81d27fe286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:36.013245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-dd86e3ee-9d91-4bae-9dac-7c81d27fe286 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:36.014799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-dd86e3ee-9d91-4bae-9dac-7c81d27fe286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:36.025856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 706/1405] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:36.070593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850bdab-374f-4e02-a0bb-6271e98d99f3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:36.089117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850bdab-374f-4e02-a0bb-6271e98d99f3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:36.097408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd872-6f66-4ef9-bba9-be18f92111db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:36.098118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd872-6f66-4ef9-bba9-be18f92111db service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:36.098463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd872-6f66-4ef9-bba9-be18f92111db service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:36.098795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd872-6f66-4ef9-bba9-be18f92111db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:36.109526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd872-6f66-4ef9-bba9-be18f92111db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:36.112169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd872-6f66-4ef9-bba9-be18f92111db service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:36.126049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 700/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:38.378542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fe6d-7216-4391-a785-5081d84c4b7c None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:38.381658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fe6d-7216-4391-a785-5081d84c4b7c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:38.382167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fe6d-7216-4391-a785-5081d84c4b7c None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:38.383825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 707/1407] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:10:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:38.389949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e07b7-645a-43d6-a3c0-7818fc766d1d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:38.390459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e07b7-645a-43d6-a3c0-7818fc766d1d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:38.390567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e07b7-645a-43d6-a3c0-7818fc766d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:38.408674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-098e07b7-645a-43d6-a3c0-7818fc766d1d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:38.410032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-098e07b7-645a-43d6-a3c0-7818fc766d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:38.418339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 701/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:38.462867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fe6d-7216-4391-a785-5081d84c4b7c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:10:38.477493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fe6d-7216-4391-a785-5081d84c4b7c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:10:38.483804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe4d64-f06c-412e-91d2-45b10ef3ddea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:10:38.484729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe4d64-f06c-412e-91d2-45b10ef3ddea service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:38.485208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe4d64-f06c-412e-91d2-45b10ef3ddea service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:38.485486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe4d64-f06c-412e-91d2-45b10ef3ddea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:38.494184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe4d64-f06c-412e-91d2-45b10ef3ddea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:10:38.495886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe4d64-f06c-412e-91d2-45b10ef3ddea service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:10:38.505834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 708/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:10:48.403319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:48.501207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=43 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:59.560455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f993-2ac4-45c5-a779-0c041402329c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:59.561093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f993-2ac4-45c5-a779-0c041402329c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:59.561093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f993-2ac4-45c5-a779-0c041402329c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:59.562430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 702/1410] 10.222.0.46 () {54 vars in 918 bytes} [Mon May 23 17:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:59.567662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfcdb-220c-467b-9048-59cd69f87f87 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:59.568121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfcdb-220c-467b-9048-59cd69f87f87 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:59.568230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfcdb-220c-467b-9048-59cd69f87f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:59.587210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7e2dfcdb-220c-467b-9048-59cd69f87f87 None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:59.588443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7e2dfcdb-220c-467b-9048-59cd69f87f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:59.598189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 709/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Mon May 23 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:10:59.616524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579092-f02d-4239-8789-3e2fc6f388b6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:59.616856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579092-f02d-4239-8789-3e2fc6f388b6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:59.617137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579092-f02d-4239-8789-3e2fc6f388b6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:59.618498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 703/1412] 10.222.0.46 () {54 vars in 918 bytes} [Mon May 23 17:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:10:59.623596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843af35-3029-4f0f-9fb0-dfc1870a32c7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:10:59.623886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843af35-3029-4f0f-9fb0-dfc1870a32c7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:10:59.624167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843af35-3029-4f0f-9fb0-dfc1870a32c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:10:59.643973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a843af35-3029-4f0f-9fb0-dfc1870a32c7 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:10:59.645188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a843af35-3029-4f0f-9fb0-dfc1870a32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:10:59.657504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 710/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Mon May 23 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:02.391686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1ee1-841f-4fa8-afa7-d411431d7be8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:02.392542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1ee1-841f-4fa8-afa7-d411431d7be8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:02.392542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1ee1-841f-4fa8-afa7-d411431d7be8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:02.394622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:02.401202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa515-5e55-45c0-a1ac-f77dd3df73d2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:02.401972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa515-5e55-45c0-a1ac-f77dd3df73d2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:02.402130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa515-5e55-45c0-a1ac-f77dd3df73d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:02.426695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f94aa515-5e55-45c0-a1ac-f77dd3df73d2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:02.427901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f94aa515-5e55-45c0-a1ac-f77dd3df73d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:02.437336 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:02.480372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1ee1-841f-4fa8-afa7-d411431d7be8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:02.495698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1ee1-841f-4fa8-afa7-d411431d7be8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:02.502607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f095de3-45f6-4b91-bc04-e5094b8a6dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:02.503250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f095de3-45f6-4b91-bc04-e5094b8a6dcb service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:02.503535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f095de3-45f6-4b91-bc04-e5094b8a6dcb service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:02.503814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f095de3-45f6-4b91-bc04-e5094b8a6dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:02.512421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f095de3-45f6-4b91-bc04-e5094b8a6dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:02.514161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f095de3-45f6-4b91-bc04-e5094b8a6dcb service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:02.524143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 705/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:11:03.498483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d390ab-0cf5-44e1-8de6-56e58ffe5dbf None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.499376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d390ab-0cf5-44e1-8de6-56e58ffe5dbf None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.499376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d390ab-0cf5-44e1-8de6-56e58ffe5dbf None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.501631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:03.508156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146f95-ee63-453c-b7b9-50508b477de0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.508906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146f95-ee63-453c-b7b9-50508b477de0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.509107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146f95-ee63-453c-b7b9-50508b477de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.535444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fe146f95-ee63-453c-b7b9-50508b477de0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:03.536747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fe146f95-ee63-453c-b7b9-50508b477de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:03.547275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:03.706264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d390ab-0cf5-44e1-8de6-56e58ffe5dbf None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:03.731714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d390ab-0cf5-44e1-8de6-56e58ffe5dbf None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:03.738602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175608-cb9d-49a8-8b86-5325c9cced18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:03.739256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175608-cb9d-49a8-8b86-5325c9cced18 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:03.739551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175608-cb9d-49a8-8b86-5325c9cced18 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:03.739835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175608-cb9d-49a8-8b86-5325c9cced18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:03.748025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175608-cb9d-49a8-8b86-5325c9cced18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:03.749759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175608-cb9d-49a8-8b86-5325c9cced18 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:03.760325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 713/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:04.707784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431364-2392-406c-8bf7-e6ef88d51e90 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.708804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431364-2392-406c-8bf7-e6ef88d51e90 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.708804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431364-2392-406c-8bf7-e6ef88d51e90 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.710852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:04.716991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa42d50-f5ce-4a7f-9816-56f7fa48a7e3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.717700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa42d50-f5ce-4a7f-9816-56f7fa48a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.717880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa42d50-f5ce-4a7f-9816-56f7fa48a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.741000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-5fa42d50-f5ce-4a7f-9816-56f7fa48a7e3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:04.742198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5fa42d50-f5ce-4a7f-9816-56f7fa48a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:04.752248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:04.901661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431364-2392-406c-8bf7-e6ef88d51e90 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:04.922543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431364-2392-406c-8bf7-e6ef88d51e90 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:04.930860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d98e12-daa3-49f0-bfd8-c6cbc514392b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:04.931824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d98e12-daa3-49f0-bfd8-c6cbc514392b service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:04.932233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d98e12-daa3-49f0-bfd8-c6cbc514392b service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:04.932512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d98e12-daa3-49f0-bfd8-c6cbc514392b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:04.941253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d98e12-daa3-49f0-bfd8-c6cbc514392b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:04.942879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d98e12-daa3-49f0-bfd8-c6cbc514392b service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:04.952502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 708/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:05.856764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05c31d-8df7-4f4b-8c77-0d79631fa422 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:05.857298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05c31d-8df7-4f4b-8c77-0d79631fa422 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:05.857420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05c31d-8df7-4f4b-8c77-0d79631fa422 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:05.858714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:05.864640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ee62-a7ce-4dee-8842-f4a9371be871 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:05.865066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ee62-a7ce-4dee-8842-f4a9371be871 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:05.865206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ee62-a7ce-4dee-8842-f4a9371be871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:05.887069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c2e5ee62-a7ce-4dee-8842-f4a9371be871 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:05.888299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c2e5ee62-a7ce-4dee-8842-f4a9371be871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:05.897247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:06.047146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05c31d-8df7-4f4b-8c77-0d79631fa422 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:06.072719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05c31d-8df7-4f4b-8c77-0d79631fa422 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:06.079388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1436f4-61da-42f0-a5ef-dd4df23d669f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:06.080041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1436f4-61da-42f0-a5ef-dd4df23d669f service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:06.080329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1436f4-61da-42f0-a5ef-dd4df23d669f service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:06.080624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1436f4-61da-42f0-a5ef-dd4df23d669f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:06.090332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1436f4-61da-42f0-a5ef-dd4df23d669f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:06.091973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1436f4-61da-42f0-a5ef-dd4df23d669f service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:06.102204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 716/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:07.000352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8a17-7584-4a4c-a4ea-30e85ea04067 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:07.001320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8a17-7584-4a4c-a4ea-30e85ea04067 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:07.001320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8a17-7584-4a4c-a4ea-30e85ea04067 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:07.003484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:07.011315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbdfc2-54eb-4078-9fec-62044e26dbde None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:07.011738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbdfc2-54eb-4078-9fec-62044e26dbde None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:07.011895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbdfc2-54eb-4078-9fec-62044e26dbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:07.032998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-75fbdfc2-54eb-4078-9fec-62044e26dbde None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:07.034212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-75fbdfc2-54eb-4078-9fec-62044e26dbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:07.042785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:07.198303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d8a17-7584-4a4c-a4ea-30e85ea04067 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:07.220060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d8a17-7584-4a4c-a4ea-30e85ea04067 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:07.226959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3532826-135a-4b89-b446-7d8648feae31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:07.227636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532826-135a-4b89-b446-7d8648feae31 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:07.227941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532826-135a-4b89-b446-7d8648feae31 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:07.228259 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532826-135a-4b89-b446-7d8648feae31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:07.237327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3532826-135a-4b89-b446-7d8648feae31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:07.238961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3532826-135a-4b89-b446-7d8648feae31 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:07.249083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 711/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:08.095412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51294f-de7f-4cfb-bc8f-59d7fdcb7cc7 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:08.096372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51294f-de7f-4cfb-bc8f-59d7fdcb7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:08.096372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51294f-de7f-4cfb-bc8f-59d7fdcb7cc7 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:08.098531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:08.106842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a416de-4765-4e21-92ff-9020a15e7819 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:08.107564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a416de-4765-4e21-92ff-9020a15e7819 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:08.107744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a416de-4765-4e21-92ff-9020a15e7819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:08.131880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-76a416de-4765-4e21-92ff-9020a15e7819 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:08.133150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-76a416de-4765-4e21-92ff-9020a15e7819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:08.142059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:08.291939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51294f-de7f-4cfb-bc8f-59d7fdcb7cc7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:08.313762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51294f-de7f-4cfb-bc8f-59d7fdcb7cc7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:08.320960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d6ed6-5777-400c-9aad-743c4102c660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:08.321614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d6ed6-5777-400c-9aad-743c4102c660 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:08.321896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d6ed6-5777-400c-9aad-743c4102c660 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:08.322170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d6ed6-5777-400c-9aad-743c4102c660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:08.331465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d6ed6-5777-400c-9aad-743c4102c660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:08.333135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d6ed6-5777-400c-9aad-743c4102c660 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:08.342985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 719/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:09.196933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad127a8-e781-4c1a-a334-1569ca7bf5b3 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:09.197524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad127a8-e781-4c1a-a334-1569ca7bf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:09.197524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad127a8-e781-4c1a-a334-1569ca7bf5b3 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:09.198905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:11:09.205283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203766f-03e7-4572-9652-23f0ce398800 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:09.206020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203766f-03e7-4572-9652-23f0ce398800 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:09.206162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203766f-03e7-4572-9652-23f0ce398800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:09.228422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9203766f-03e7-4572-9652-23f0ce398800 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:09.229701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9203766f-03e7-4572-9652-23f0ce398800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:09.238351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:09.387856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad127a8-e781-4c1a-a334-1569ca7bf5b3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:09.413764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad127a8-e781-4c1a-a334-1569ca7bf5b3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:09.420802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b8f6e-141a-405a-88ac-35a920957269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:09.421458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8f6e-141a-405a-88ac-35a920957269 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:09.421744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8f6e-141a-405a-88ac-35a920957269 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:09.422023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8f6e-141a-405a-88ac-35a920957269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:09.430993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b8f6e-141a-405a-88ac-35a920957269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:09.432648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b8f6e-141a-405a-88ac-35a920957269 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:09.442539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 714/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:10.282936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a34c-3c44-4e98-b3b7-cfaf361467c0 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:10.283798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a34c-3c44-4e98-b3b7-cfaf361467c0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:10.283798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a34c-3c44-4e98-b3b7-cfaf361467c0 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:10.286077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:10.293455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b582-06ed-4fc0-a71c-610c77a854d7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:10.293946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b582-06ed-4fc0-a71c-610c77a854d7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:10.294046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b582-06ed-4fc0-a71c-610c77a854d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:10.313167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9dd7b582-06ed-4fc0-a71c-610c77a854d7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:10.314374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9dd7b582-06ed-4fc0-a71c-610c77a854d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:10.322960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:10.487129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824a34c-3c44-4e98-b3b7-cfaf361467c0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:10.506222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824a34c-3c44-4e98-b3b7-cfaf361467c0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:10.511968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3feee-dec8-4d66-9af7-956a91757413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:10.512657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3feee-dec8-4d66-9af7-956a91757413 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:10.512962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3feee-dec8-4d66-9af7-956a91757413 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:10.513242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3feee-dec8-4d66-9af7-956a91757413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:10.522245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3feee-dec8-4d66-9af7-956a91757413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:10.523947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3feee-dec8-4d66-9af7-956a91757413 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:10.535808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 722/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:11.395482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195197-5554-4e66-9f19-8ac3bb65f3f8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:11.396192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195197-5554-4e66-9f19-8ac3bb65f3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:11.396281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195197-5554-4e66-9f19-8ac3bb65f3f8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:11.397731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:11.403781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629497-4d1d-4ee9-a978-cb0f4abd38f3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:11.404272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629497-4d1d-4ee9-a978-cb0f4abd38f3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:11.404365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629497-4d1d-4ee9-a978-cb0f4abd38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:11.424979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ab629497-4d1d-4ee9-a978-cb0f4abd38f3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:11.426858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ab629497-4d1d-4ee9-a978-cb0f4abd38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:11.436947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:11.586428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195197-5554-4e66-9f19-8ac3bb65f3f8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:11.611989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195197-5554-4e66-9f19-8ac3bb65f3f8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:11.617948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b35c4-cfc0-40b6-bcf0-4bb3b084a4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:11.618610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b35c4-cfc0-40b6-bcf0-4bb3b084a4bd service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:11.618896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b35c4-cfc0-40b6-bcf0-4bb3b084a4bd service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:11.619177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b35c4-cfc0-40b6-bcf0-4bb3b084a4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:11.628049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b35c4-cfc0-40b6-bcf0-4bb3b084a4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:11.629708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b35c4-cfc0-40b6-bcf0-4bb3b084a4bd service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:11.640333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 717/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:13.734993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe87cd-3879-4426-bb7e-39b249cf4723 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:13.735595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe87cd-3879-4426-bb7e-39b249cf4723 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:13.735595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe87cd-3879-4426-bb7e-39b249cf4723 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:13.736956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:13.743404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966b58-3411-4f73-ad8b-559d78600f4f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:13.743875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966b58-3411-4f73-ad8b-559d78600f4f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:13.743968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966b58-3411-4f73-ad8b-559d78600f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:13.763257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-98966b58-3411-4f73-ad8b-559d78600f4f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:13.764878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-98966b58-3411-4f73-ad8b-559d78600f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:13.774015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:13.820280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe87cd-3879-4426-bb7e-39b249cf4723 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:13.831482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe87cd-3879-4426-bb7e-39b249cf4723 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:13.835061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c802a-5ebc-459f-93fd-4e88824c48ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:13.835707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c802a-5ebc-459f-93fd-4e88824c48ff service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:13.835987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c802a-5ebc-459f-93fd-4e88824c48ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:13.836260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c802a-5ebc-459f-93fd-4e88824c48ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:13.845414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c802a-5ebc-459f-93fd-4e88824c48ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:13.846874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c802a-5ebc-459f-93fd-4e88824c48ff service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:13.856206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 725/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:11:16.281940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743241f-8abc-4336-9e6d-93a22088b4a0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:16.282840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743241f-8abc-4336-9e6d-93a22088b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:16.282840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743241f-8abc-4336-9e6d-93a22088b4a0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:16.285210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:16.293631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173773-09b0-417d-af72-884269a26793 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:16.294083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173773-09b0-417d-af72-884269a26793 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:16.294201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173773-09b0-417d-af72-884269a26793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:16.314861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b2173773-09b0-417d-af72-884269a26793 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:16.316093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b2173773-09b0-417d-af72-884269a26793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:16.325111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:16.365542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743241f-8abc-4336-9e6d-93a22088b4a0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:16.378014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743241f-8abc-4336-9e6d-93a22088b4a0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:16.381852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f5c13-8a94-43e7-8f76-5b071e582987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:16.382504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f5c13-8a94-43e7-8f76-5b071e582987 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:16.382788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f5c13-8a94-43e7-8f76-5b071e582987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:16.383064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f5c13-8a94-43e7-8f76-5b071e582987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:16.392675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f5c13-8a94-43e7-8f76-5b071e582987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:16.394161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f5c13-8a94-43e7-8f76-5b071e582987 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:16.403579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 720/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:18.900054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d9c40-f721-4859-bff6-22a6eaa55ad8 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:18.900830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d9c40-f721-4859-bff6-22a6eaa55ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:18.900924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d9c40-f721-4859-bff6-22a6eaa55ad8 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:18.902273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:18.907924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd574ca-4c6a-48ef-82fb-11f29efc4d99 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:18.908366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd574ca-4c6a-48ef-82fb-11f29efc4d99 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:18.908455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd574ca-4c6a-48ef-82fb-11f29efc4d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:18.935718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3fd574ca-4c6a-48ef-82fb-11f29efc4d99 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:18.936930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3fd574ca-4c6a-48ef-82fb-11f29efc4d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:18.946314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:11:18.988351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d9c40-f721-4859-bff6-22a6eaa55ad8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:19.003335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d9c40-f721-4859-bff6-22a6eaa55ad8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:19.008106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae345f-97fe-4115-83cb-cf970f59161f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:19.008796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae345f-97fe-4115-83cb-cf970f59161f service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:19.009078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae345f-97fe-4115-83cb-cf970f59161f service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:19.009354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae345f-97fe-4115-83cb-cf970f59161f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:19.023025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae345f-97fe-4115-83cb-cf970f59161f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:19.025563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae345f-97fe-4115-83cb-cf970f59161f service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:19.035552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 728/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:21.382830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256cb1-fb37-419e-b9f0-4b5b8faf969b None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:21.383790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256cb1-fb37-419e-b9f0-4b5b8faf969b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:21.383790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256cb1-fb37-419e-b9f0-4b5b8faf969b None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:21.385985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:21.395407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780f9c-551b-4974-b7c6-1fb1fe2ff78e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:21.395867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780f9c-551b-4974-b7c6-1fb1fe2ff78e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:21.396029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780f9c-551b-4974-b7c6-1fb1fe2ff78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:21.416689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-00780f9c-551b-4974-b7c6-1fb1fe2ff78e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:21.417904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-00780f9c-551b-4974-b7c6-1fb1fe2ff78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:21.426217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:21.465231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256cb1-fb37-419e-b9f0-4b5b8faf969b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:21.478714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256cb1-fb37-419e-b9f0-4b5b8faf969b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:21.483523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ea21-4b10-4585-a4ad-079cb087d89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:21.484171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ea21-4b10-4585-a4ad-079cb087d89b service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:21.484427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ea21-4b10-4585-a4ad-079cb087d89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:21.484733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ea21-4b10-4585-a4ad-079cb087d89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:21.494748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780ea21-4b10-4585-a4ad-079cb087d89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:21.496209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780ea21-4b10-4585-a4ad-079cb087d89b service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:21.505648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 723/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:23.838098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf8484-0c01-4010-9802-0b8c4fc97e7d None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:23.838631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf8484-0c01-4010-9802-0b8c4fc97e7d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:23.838631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf8484-0c01-4010-9802-0b8c4fc97e7d None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:23.840044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:23.846463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ef49e-ab08-43d2-92da-bca959835265 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:23.847251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ef49e-ab08-43d2-92da-bca959835265 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:23.847251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ef49e-ab08-43d2-92da-bca959835265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:23.873120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-514ef49e-ab08-43d2-92da-bca959835265 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:23.874323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-514ef49e-ab08-43d2-92da-bca959835265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:23.882938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:23.921277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf8484-0c01-4010-9802-0b8c4fc97e7d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:23.937633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf8484-0c01-4010-9802-0b8c4fc97e7d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:23.941900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd09ab9-01a3-4bff-a974-fc4bbe0e9f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:23.942545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09ab9-01a3-4bff-a974-fc4bbe0e9f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:23.942791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09ab9-01a3-4bff-a974-fc4bbe0e9f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:23.943093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09ab9-01a3-4bff-a974-fc4bbe0e9f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:23.952739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd09ab9-01a3-4bff-a974-fc4bbe0e9f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:23.954215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd09ab9-01a3-4bff-a974-fc4bbe0e9f4b service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:23.963632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 731/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:26.248714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8674b-d6a7-44f7-bb78-ab250963fe32 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:26.249611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8674b-d6a7-44f7-bb78-ab250963fe32 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:26.249611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8674b-d6a7-44f7-bb78-ab250963fe32 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:26.251953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:26.257618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a23ba-efec-4449-ac72-58c7f7a0ca20 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:26.258075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a23ba-efec-4449-ac72-58c7f7a0ca20 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:26.258179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a23ba-efec-4449-ac72-58c7f7a0ca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:26.277997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ef5a23ba-efec-4449-ac72-58c7f7a0ca20 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:26.279214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ef5a23ba-efec-4449-ac72-58c7f7a0ca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:26.288244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:26.336774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8674b-d6a7-44f7-bb78-ab250963fe32 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:26.349784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8674b-d6a7-44f7-bb78-ab250963fe32 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:26.353895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21202-952f-4536-bdd6-acdca4511bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:26.354542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21202-952f-4536-bdd6-acdca4511bca service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:26.354827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21202-952f-4536-bdd6-acdca4511bca service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:26.355104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21202-952f-4536-bdd6-acdca4511bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:26.364713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21202-952f-4536-bdd6-acdca4511bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:26.366164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21202-952f-4536-bdd6-acdca4511bca service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:26.377373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 726/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:28.629934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8f8bf-3b0d-4dad-b688-e9c6123bc70f None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:28.630502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8f8bf-3b0d-4dad-b688-e9c6123bc70f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:28.630502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8f8bf-3b0d-4dad-b688-e9c6123bc70f None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:28.631905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:28.637595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af6eb-553e-4b15-8c0e-b4c25b0315b7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:28.638098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af6eb-553e-4b15-8c0e-b4c25b0315b7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:28.638188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af6eb-553e-4b15-8c0e-b4c25b0315b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:28.645208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=70 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:28.658411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-180af6eb-553e-4b15-8c0e-b4c25b0315b7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:28.659630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-180af6eb-553e-4b15-8c0e-b4c25b0315b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:28.667944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:28.704719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8f8bf-3b0d-4dad-b688-e9c6123bc70f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:28.710611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=73 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:28.717480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8f8bf-3b0d-4dad-b688-e9c6123bc70f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:28.721111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e773c-3f8e-47cb-9b13-f12dfc2f415b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:28.721781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e773c-3f8e-47cb-9b13-f12dfc2f415b service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:28.722066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e773c-3f8e-47cb-9b13-f12dfc2f415b service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:28.722351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e773c-3f8e-47cb-9b13-f12dfc2f415b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:28.732021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e773c-3f8e-47cb-9b13-f12dfc2f415b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:28.733505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e773c-3f8e-47cb-9b13-f12dfc2f415b service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:28.743002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 734/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:30.968613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085acb0-d75d-4fe5-b09d-e843eacb47ae None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:30.969205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085acb0-d75d-4fe5-b09d-e843eacb47ae None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:30.969205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085acb0-d75d-4fe5-b09d-e843eacb47ae None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:30.970705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:30.977134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb589e-8b7f-49db-bd84-9232305e4da0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:30.977908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb589e-8b7f-49db-bd84-9232305e4da0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:30.978097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb589e-8b7f-49db-bd84-9232305e4da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:30.998925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3ffb589e-8b7f-49db-bd84-9232305e4da0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:31.000700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3ffb589e-8b7f-49db-bd84-9232305e4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:31.012577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:31.063481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085acb0-d75d-4fe5-b09d-e843eacb47ae None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:31.078402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085acb0-d75d-4fe5-b09d-e843eacb47ae None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:31.082639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aedc4d-9cbc-4017-82a9-582db13ac531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:31.083270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aedc4d-9cbc-4017-82a9-582db13ac531 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:31.083586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aedc4d-9cbc-4017-82a9-582db13ac531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:31.083860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aedc4d-9cbc-4017-82a9-582db13ac531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:31.094293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aedc4d-9cbc-4017-82a9-582db13ac531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:31.095769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aedc4d-9cbc-4017-82a9-582db13ac531 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:31.105752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 729/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:33.294992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0977-ed45-4df5-8ae4-a653707089a2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:33.295622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0977-ed45-4df5-8ae4-a653707089a2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:33.295622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0977-ed45-4df5-8ae4-a653707089a2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:33.297747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:33.306861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219da7f-4ffc-4091-88b6-62210a1ed804 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:33.307297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219da7f-4ffc-4091-88b6-62210a1ed804 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:33.307472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219da7f-4ffc-4091-88b6-62210a1ed804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:33.332201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1219da7f-4ffc-4091-88b6-62210a1ed804 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:33.333442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1219da7f-4ffc-4091-88b6-62210a1ed804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:33.342855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:33.381757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0977-ed45-4df5-8ae4-a653707089a2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:33.394834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0977-ed45-4df5-8ae4-a653707089a2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:33.399257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb9934-c4a3-46ce-a97b-2bb6d6511c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:33.399906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb9934-c4a3-46ce-a97b-2bb6d6511c76 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:33.400189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb9934-c4a3-46ce-a97b-2bb6d6511c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:33.400465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb9934-c4a3-46ce-a97b-2bb6d6511c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:33.409692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb9934-c4a3-46ce-a97b-2bb6d6511c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:33.411157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb9934-c4a3-46ce-a97b-2bb6d6511c76 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:33.420499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 737/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:11:35.632322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3c0e0-1c0d-4212-bd73-7ede7661f9e7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:35.632959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3c0e0-1c0d-4212-bd73-7ede7661f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:35.632959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3c0e0-1c0d-4212-bd73-7ede7661f9e7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:35.634298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:11:35.640328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb4dc-e890-4e44-8f13-ae74604d95d6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:35.640783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb4dc-e890-4e44-8f13-ae74604d95d6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:35.640896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb4dc-e890-4e44-8f13-ae74604d95d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:35.660159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d06cb4dc-e890-4e44-8f13-ae74604d95d6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:11:35.661392 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d06cb4dc-e890-4e44-8f13-ae74604d95d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:11:35.669808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:11:35.709295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3c0e0-1c0d-4212-bd73-7ede7661f9e7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:11:35.723062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3c0e0-1c0d-4212-bd73-7ede7661f9e7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:11:35.727233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07458e-c47c-4ce6-b4e1-f634a95ec3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:11:35.727865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07458e-c47c-4ce6-b4e1-f634a95ec3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:11:35.728152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07458e-c47c-4ce6-b4e1-f634a95ec3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:11:35.728432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07458e-c47c-4ce6-b4e1-f634a95ec3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:11:35.740150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07458e-c47c-4ce6-b4e1-f634a95ec3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:11:35.742497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07458e-c47c-4ce6-b4e1-f634a95ec3f3 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:11:35.755309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 732/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:11:45.654927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=17 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:45.748630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=17 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:08.368806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8cabb-de0f-444f-af8d-6c2f288476c4 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:08.369450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8cabb-de0f-444f-af8d-6c2f288476c4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:08.369450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8cabb-de0f-444f-af8d-6c2f288476c4 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:08.370753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 739/1471] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:08.377303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dd00-fbe8-4c43-8901-617b039cb044 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:08.378076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dd00-fbe8-4c43-8901-617b039cb044 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:08.378238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95dd00-fbe8-4c43-8901-617b039cb044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:08.400309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7c95dd00-fbe8-4c43-8901-617b039cb044 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:08.401551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7c95dd00-fbe8-4c43-8901-617b039cb044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:08.412697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 733/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:08.459298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be362-cfae-4596-bdb4-5fa648581311 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:08.459587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be362-cfae-4596-bdb4-5fa648581311 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:08.459860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be362-cfae-4596-bdb4-5fa648581311 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:08.461264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 740/1473] 10.222.0.46 () {54 vars in 962 bytes} [Mon May 23 17:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:08.467333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56d1a3-1373-4f37-a432-9a5a34ffdbc4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:08.467868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56d1a3-1373-4f37-a432-9a5a34ffdbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:08.468316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56d1a3-1373-4f37-a432-9a5a34ffdbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:08.492025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1a56d1a3-1373-4f37-a432-9a5a34ffdbc4 None None] MFA Rules not processed for user `49486e8648f34ebf82979c60ab45ff6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:08.493258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1a56d1a3-1373-4f37-a432-9a5a34ffdbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:08.500981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 734/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Mon May 23 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:08.508394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269be362-cfae-4596-bdb4-5fa648581311 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:08.521247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269be362-cfae-4596-bdb4-5fa648581311 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:08.525678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8c431-a281-490f-84c9-246ef3dc36a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:08.526323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8c431-a281-490f-84c9-246ef3dc36a6 service glance] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:08.526609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8c431-a281-490f-84c9-246ef3dc36a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:08.526889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8c431-a281-490f-84c9-246ef3dc36a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:08.536482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8c431-a281-490f-84c9-246ef3dc36a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:08.537975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8c431-a281-490f-84c9-246ef3dc36a6 service glance] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:08.550733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 741/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:10.816988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf4021-a3d7-4f85-af2d-4ecf2140e7dd None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:10.817469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf4021-a3d7-4f85-af2d-4ecf2140e7dd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:10.817584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf4021-a3d7-4f85-af2d-4ecf2140e7dd None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:10.819679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 735/1476] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:10.825230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5a6e-33c4-4536-8177-17685457afb8 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:10.825667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5a6e-33c4-4536-8177-17685457afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:10.825804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5a6e-33c4-4536-8177-17685457afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:10.845860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-090f5a6e-33c4-4536-8177-17685457afb8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:10.847063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-090f5a6e-33c4-4536-8177-17685457afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:10.856178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 742/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:10.879983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf4021-a3d7-4f85-af2d-4ecf2140e7dd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:10.900800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf4021-a3d7-4f85-af2d-4ecf2140e7dd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:10.906823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:10.907726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:10.908021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:10.908385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:10.909492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:10.912244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:12:10.912244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:12:10.912244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:12:10.914086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92494bf-b0a5-438d-a2d6-957d8a87c91f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:10.941997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 736/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 17:12:10 2022] GET /identity/v3/projects => generated 2553 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:12:13.147202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aaa9-d669-4760-a736-03fc404620e2 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:13.148044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aaa9-d669-4760-a736-03fc404620e2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:13.148214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aaa9-d669-4760-a736-03fc404620e2 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:13.150670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 743/1479] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:13.157176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486161b1-3dd2-4a13-b76f-0f6ae6f8e172 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:13.157634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486161b1-3dd2-4a13-b76f-0f6ae6f8e172 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:13.157748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486161b1-3dd2-4a13-b76f-0f6ae6f8e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:13.177676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-486161b1-3dd2-4a13-b76f-0f6ae6f8e172 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:13.178883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-486161b1-3dd2-4a13-b76f-0f6ae6f8e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:13.190396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 737/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:13.235692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aaa9-d669-4760-a736-03fc404620e2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:13.251943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aaa9-d669-4760-a736-03fc404620e2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:13.258216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e324a3-9334-4ab3-984b-ec3e5cebbf43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:13.258875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e324a3-9334-4ab3-984b-ec3e5cebbf43 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:13.259159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e324a3-9334-4ab3-984b-ec3e5cebbf43 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:13.259438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e324a3-9334-4ab3-984b-ec3e5cebbf43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:13.269220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e324a3-9334-4ab3-984b-ec3e5cebbf43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:13.270846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e324a3-9334-4ab3-984b-ec3e5cebbf43 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:13.280754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 744/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:15.663515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30aeb-274f-4fc5-80c2-7858fc82f5b0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:15.664120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30aeb-274f-4fc5-80c2-7858fc82f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:15.664120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30aeb-274f-4fc5-80c2-7858fc82f5b0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:15.665540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 738/1482] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:15.671127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306999d-e8d0-4dfb-964c-bebf89be28d7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:15.671595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306999d-e8d0-4dfb-964c-bebf89be28d7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:15.671715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306999d-e8d0-4dfb-964c-bebf89be28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:15.692470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f306999d-e8d0-4dfb-964c-bebf89be28d7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:15.693733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f306999d-e8d0-4dfb-964c-bebf89be28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:15.703297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 745/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:15.751260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30aeb-274f-4fc5-80c2-7858fc82f5b0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:15.764744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30aeb-274f-4fc5-80c2-7858fc82f5b0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:15.769682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4697dc4-1008-427d-b48c-d833cf17b2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:15.770333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4697dc4-1008-427d-b48c-d833cf17b2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:15.770616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4697dc4-1008-427d-b48c-d833cf17b2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:15.770888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4697dc4-1008-427d-b48c-d833cf17b2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:15.781063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4697dc4-1008-427d-b48c-d833cf17b2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:15.782522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4697dc4-1008-427d-b48c-d833cf17b2b3 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:15.792852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 739/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:18.032961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751a49-bb6b-41cc-afcc-442639b008fe None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:18.033845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751a49-bb6b-41cc-afcc-442639b008fe None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:18.033845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751a49-bb6b-41cc-afcc-442639b008fe None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:18.036027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 746/1485] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:18.044011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4b0d-2375-47f5-b4ea-27860d902421 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:18.044470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4b0d-2375-47f5-b4ea-27860d902421 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:18.044632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4b0d-2375-47f5-b4ea-27860d902421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:18.064713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cffe4b0d-2375-47f5-b4ea-27860d902421 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:18.065843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cffe4b0d-2375-47f5-b4ea-27860d902421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:18.074237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 740/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:18.112008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751a49-bb6b-41cc-afcc-442639b008fe None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:18.131429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751a49-bb6b-41cc-afcc-442639b008fe None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:18.136213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a464b-59a3-4625-b90d-3c0933cb6636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:18.136914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a464b-59a3-4625-b90d-3c0933cb6636 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:18.137202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a464b-59a3-4625-b90d-3c0933cb6636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:18.137484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a464b-59a3-4625-b90d-3c0933cb6636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:18.148522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a464b-59a3-4625-b90d-3c0933cb6636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:18.150045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a464b-59a3-4625-b90d-3c0933cb6636 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:18.160052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 747/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:20.421874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10638167-803b-4e65-935e-c0d845991ef1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:20.422773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10638167-803b-4e65-935e-c0d845991ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:20.422773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10638167-803b-4e65-935e-c0d845991ef1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:20.425058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 741/1488] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:20.434187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a126-c72c-4d66-94f8-f6673d656a9d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:20.434605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a126-c72c-4d66-94f8-f6673d656a9d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:20.434833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a126-c72c-4d66-94f8-f6673d656a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:20.460212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ac86a126-c72c-4d66-94f8-f6673d656a9d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:20.461459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ac86a126-c72c-4d66-94f8-f6673d656a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:20.471080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 748/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:12:20.520627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10638167-803b-4e65-935e-c0d845991ef1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:20.539954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10638167-803b-4e65-935e-c0d845991ef1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:20.544629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6804253-eac2-4904-b38b-8f8eca8aaeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:20.545308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6804253-eac2-4904-b38b-8f8eca8aaeeb service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:20.545590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6804253-eac2-4904-b38b-8f8eca8aaeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:20.545861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6804253-eac2-4904-b38b-8f8eca8aaeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:20.555775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6804253-eac2-4904-b38b-8f8eca8aaeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:20.557272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6804253-eac2-4904-b38b-8f8eca8aaeeb service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:20.567026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 742/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:22.956076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c6ee3-28cc-4ca7-9776-4974cf8bca31 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:22.956710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c6ee3-28cc-4ca7-9776-4974cf8bca31 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:22.956710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c6ee3-28cc-4ca7-9776-4974cf8bca31 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:22.958032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 749/1491] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 17:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:12:22.964403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9412-f5b9-4189-8bfa-d6611aa63cd7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:22.964950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9412-f5b9-4189-8bfa-d6611aa63cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:22.964950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9412-f5b9-4189-8bfa-d6611aa63cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:22.992566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-46db9412-f5b9-4189-8bfa-d6611aa63cd7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:12:22.993975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-46db9412-f5b9-4189-8bfa-d6611aa63cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:12:23.002667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 743/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:12:23.044381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c6ee3-28cc-4ca7-9776-4974cf8bca31 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:12:23.061099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c6ee3-28cc-4ca7-9776-4974cf8bca31 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:12:23.065502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e05f0-ad01-4b5b-a40e-cb258007876e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:12:23.066157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e05f0-ad01-4b5b-a40e-cb258007876e service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:12:23.066440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e05f0-ad01-4b5b-a40e-cb258007876e service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:12:23.066715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e05f0-ad01-4b5b-a40e-cb258007876e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:12:23.076152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e05f0-ad01-4b5b-a40e-cb258007876e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:12:23.077647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e05f0-ad01-4b5b-a40e-cb258007876e service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:12:23.087279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 750/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:12:32.984441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=33 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:33.083086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=33 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:03.344477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.345494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.345494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.374632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:03.375848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:03.384458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 744/1494] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:03.394214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.394743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.394743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.414274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:03.415465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:03.424874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 751/1495] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:03.429588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:03.439845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9acf-0a09-4351-8a01-4980f037c4f7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:03.445328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:03.446026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.446330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.446561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.447312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:14:03.447625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:03.448695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:03.448695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:14:03.448695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:14:03.449585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:03.461872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 745/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:14:03.470457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:03.484268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64db3d-dd5d-4abf-b9e5-4d94a167dc3a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:03.490215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:03.490881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.491164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.491437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.492126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:03.494442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:03.494442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:14:03.494442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:14:03.495996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:03.537110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 752/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:14:03 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:14:03.543104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:03.553807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c033b8d-4a5f-4b9b-bfdf-2cac177bd7d1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:03.621207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:03.622233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.622533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.622813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.623958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:03.625953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:03.625953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:14:03.625953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:14:03.628388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:03.657169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 746/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:14:03 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:14:03.663653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:03.678034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a011-8b65-4034-88bf-38d3a649a2ac admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:03.683306 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:03.683982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.684277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.684571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.685324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:03.686373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:03.686373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:14:03.686373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:14:03.687282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:03.700839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 753/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:03.705059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:03.715579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db503bc0-892a-4e19-b6ee-a7b406eb4eb4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:03.720816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:03.721506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.721794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.722085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.722822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:03.723884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:03.723884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:14:03.723884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:14:03.724831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911246f-1500-4f39-a746-a2461225bfda admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:03.738794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 747/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:14:03.743640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:03.758881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79506f0-f863-4b06-bdc2-300eaa0694d8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:03.765409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:03.766367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.766646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.766922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] PATH_INFO: `/v3/projects/f836e83e30704a659e3a02fddba361ec/users/87e2879bb3394e2b839b4d77d467bea4/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.786624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f836e83e30704a659e3a02fddba361ec, user_id=87e2879bb3394e2b839b4d77d467bea4, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:03.787777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:03.787777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:14:03.787777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:14:03.789906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ed244-dbe1-41ff-829c-5d969015b1c0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:03.808085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 754/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:14:03 2022] PUT /identity/v3/projects/f836e83e30704a659e3a02fddba361ec/users/87e2879bb3394e2b839b4d77d467bea4/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:03.826125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023160c4-7cfb-41d4-8b9d-8fc3fe7e7235 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.826421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023160c4-7cfb-41d4-8b9d-8fc3fe7e7235 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.826698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023160c4-7cfb-41d4-8b9d-8fc3fe7e7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.857736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-023160c4-7cfb-41d4-8b9d-8fc3fe7e7235 None None] MFA Rules not processed for user `87e2879bb3394e2b839b4d77d467bea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:03.859603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-023160c4-7cfb-41d4-8b9d-8fc3fe7e7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:03.938864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 748/1502] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:03.952958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d42-a32c-4f0d-a3e1-21337168ab80 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.953248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d42-a32c-4f0d-a3e1-21337168ab80 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.953528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6d42-a32c-4f0d-a3e1-21337168ab80 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.954943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 755/1503] 10.222.0.46 () {54 vars in 963 bytes} [Mon May 23 17:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:14:03.959956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716b7cf-764f-4c4c-8bd2-5fe976e5961c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:03.960256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716b7cf-764f-4c4c-8bd2-5fe976e5961c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:03.960537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716b7cf-764f-4c4c-8bd2-5fe976e5961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:03.980261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9716b7cf-764f-4c4c-8bd2-5fe976e5961c None None] MFA Rules not processed for user `d7460f33e2f74a1e86b76eab550b7c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:03.981539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9716b7cf-764f-4c4c-8bd2-5fe976e5961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:04.031181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:04.040564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 749/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Mon May 23 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:14:04.048794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6d42-a32c-4f0d-a3e1-21337168ab80 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:04.060854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6d42-a32c-4f0d-a3e1-21337168ab80 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:04.064921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:04.065580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:04.065867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:04.066129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:04.075902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:04.077472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:04.086678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 756/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:14:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:04.132038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1c25-2ddd-4ed1-91a1-689591191f4f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:04.132340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1c25-2ddd-4ed1-91a1-689591191f4f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:04.132647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1c25-2ddd-4ed1-91a1-689591191f4f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:04.133965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 750/1506] 10.222.0.46 () {52 vars in 829 bytes} [Mon May 23 17:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:14:04.137870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:04.210692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580ad6-6d80-419e-aaa7-3c2e9bd9ebc9 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:04.215592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:04.216620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:04.216917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:04.217193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] PATH_INFO: `/v3/users/87e2879bb3394e2b839b4d77d467bea4` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:04.218522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e2879bb3394e2b839b4d77d467bea4)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:04.219562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:04.219562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:14:04.219562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:14:04.220795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:04.293176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e2879bb3394e2b839b4d77d467bea4'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:04.307791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e2879bb3394e2b839b4d77d467bea4'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:04.329127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e2879bb3394e2b839b4d77d467bea4'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:04.329984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e2879bb3394e2b839b4d77d467bea4'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:04.334039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:04.342874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e2879bb3394e2b839b4d77d467bea4'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:04.352111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 757/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:14:04 2022] DELETE /identity/v3/users/87e2879bb3394e2b839b4d77d467bea4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:04.357012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:04.357514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:04.357609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:04.378148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:14:04.380165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:04.449820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 751/1508] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:14:04.462165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:04.464474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:04.531720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0bf5e-235d-494d-a71b-d7b622f664c3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:04.536044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e824e-66a9-4e2c-9940-61b6dc3da4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:04.536770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e824e-66a9-4e2c-9940-61b6dc3da4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:04.537056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e824e-66a9-4e2c-9940-61b6dc3da4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:04.537338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e824e-66a9-4e2c-9940-61b6dc3da4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:04.552234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e824e-66a9-4e2c-9940-61b6dc3da4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:04.553853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e824e-66a9-4e2c-9940-61b6dc3da4b8 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:04.564180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 758/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:14:05.005021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:14:05.006498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:14:05.019712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead4030-68d9-4029-aacc-a86a99335582 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:14:05.025287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:14:05.026186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:14:05.026493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:14:05.026752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] PATH_INFO: `/v3/projects/f836e83e30704a659e3a02fddba361ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:14:05.028035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f836e83e30704a659e3a02fddba361ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:14:05.029181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:14:05.029181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:14:05.029181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:14:05.030580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:14:05.093977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f836e83e30704a659e3a02fddba361ec', 'request_id': 'req-7d378214-3cae-472b-97b5-a7088b01b97b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:05.107524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f836e83e30704a659e3a02fddba361ec', 'request_id': 'req-7d378214-3cae-472b-97b5-a7088b01b97b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:05.120217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f836e83e30704a659e3a02fddba361ec', 'request_id': 'req-7d378214-3cae-472b-97b5-a7088b01b97b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:05.132186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] The token cache is being invalidate because project f836e83e30704a659e3a02fddba361ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:14:05.132476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:05.133263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7d378214-3cae-472b-97b5-a7088b01b97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:14:05.134955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 752/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:14:05 2022] DELETE /identity/v3/projects/f836e83e30704a659e3a02fddba361ec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:14:14.559503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:14:15.129034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:41.476409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20022-eacc-40db-a2fb-82870913761e None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:41.477099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20022-eacc-40db-a2fb-82870913761e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:41.477099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20022-eacc-40db-a2fb-82870913761e None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:41.478663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:15:41.483839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49614d-c3ef-4a70-920d-faa4352fb367 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:41.484298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49614d-c3ef-4a70-920d-faa4352fb367 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:41.484437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49614d-c3ef-4a70-920d-faa4352fb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:41.503697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3f49614d-c3ef-4a70-920d-faa4352fb367 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:41.504912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3f49614d-c3ef-4a70-920d-faa4352fb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:41.565914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:41.733027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f20022-eacc-40db-a2fb-82870913761e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:41.735421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-96f20022-eacc-40db-a2fb-82870913761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:41.815259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f20022-eacc-40db-a2fb-82870913761e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:41.821283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9121-118e-42b2-b9f6-8ee65e46fb7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:41.821956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9121-118e-42b2-b9f6-8ee65e46fb7f service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:41.822243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9121-118e-42b2-b9f6-8ee65e46fb7f service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:41.822521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9121-118e-42b2-b9f6-8ee65e46fb7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:41.832243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded9121-118e-42b2-b9f6-8ee65e46fb7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:41.833952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded9121-118e-42b2-b9f6-8ee65e46fb7f service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:41.843576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 760/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:42.687915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3f95-a058-4e4e-abf5-db6789930a2d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.688527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3f95-a058-4e4e-abf5-db6789930a2d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.688527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3f95-a058-4e4e-abf5-db6789930a2d None None] PATH_INFO: `/v3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.689813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 754/1514] 10.222.0.50 () {54 vars in 925 bytes} [Mon May 23 17:15:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:15:42.696478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd691d09-ecae-44f0-b612-bfd5079d016f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.696955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd691d09-ecae-44f0-b612-bfd5079d016f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.697068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd691d09-ecae-44f0-b612-bfd5079d016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.716447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bd691d09-ecae-44f0-b612-bfd5079d016f None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:42.717784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bd691d09-ecae-44f0-b612-bfd5079d016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:42.733796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f007a2-35df-4375-abed-0ba0219b8ede None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.734093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f007a2-35df-4375-abed-0ba0219b8ede None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.734410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f007a2-35df-4375-abed-0ba0219b8ede None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.735820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 755/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:15:42.741152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.741448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.741733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.761723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:42.763255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:42.772588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 756/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:42.797708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 761/1517] 10.222.0.50 () {58 vars in 1015 bytes} [Mon May 23 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:42.923881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:42.937630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ae26-e352-44c5-aed0-c073ff3c02b2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:42.944473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088fb00-291b-4285-bcf5-c34f0ac4ed98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:42.945098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088fb00-291b-4285-bcf5-c34f0ac4ed98 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:42.945387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088fb00-291b-4285-bcf5-c34f0ac4ed98 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:42.945669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088fb00-291b-4285-bcf5-c34f0ac4ed98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:42.954188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088fb00-291b-4285-bcf5-c34f0ac4ed98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:42.955834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088fb00-291b-4285-bcf5-c34f0ac4ed98 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:42.966022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 757/1518] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:46.672480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879380-f21f-4c02-91bc-b319ee1f53e6 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:46.673069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879380-f21f-4c02-91bc-b319ee1f53e6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:46.673198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879380-f21f-4c02-91bc-b319ee1f53e6 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:46.674677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 762/1519] 10.222.0.46 () {54 vars in 960 bytes} [Mon May 23 17:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:15:46.680193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b636ff-f4c8-4927-abc2-f358ea1e1fee None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:46.680633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b636ff-f4c8-4927-abc2-f358ea1e1fee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:46.680807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b636ff-f4c8-4927-abc2-f358ea1e1fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:46.701545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f8b636ff-f4c8-4927-abc2-f358ea1e1fee None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:46.702765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f8b636ff-f4c8-4927-abc2-f358ea1e1fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:46.712964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 758/1520] 10.222.0.46 () {58 vars in 1057 bytes} [Mon May 23 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:46.721253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879380-f21f-4c02-91bc-b319ee1f53e6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:46.745495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879380-f21f-4c02-91bc-b319ee1f53e6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:46.751585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc60e-fa87-46a9-b3b4-d2c99747e1a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:46.752241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc60e-fa87-46a9-b3b4-d2c99747e1a3 service placement] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:46.752526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc60e-fa87-46a9-b3b4-d2c99747e1a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:46.752857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc60e-fa87-46a9-b3b4-d2c99747e1a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:46.762021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcc60e-fa87-46a9-b3b4-d2c99747e1a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:46.763682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcc60e-fa87-46a9-b3b4-d2c99747e1a3 service placement] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:46.774617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 763/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:15:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:54.271536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3649de-9a22-423a-9fa3-d56e555cc29e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.272515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3649de-9a22-423a-9fa3-d56e555cc29e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.272515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3649de-9a22-423a-9fa3-d56e555cc29e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.274681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:15:54.281615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c35e-7fa9-4938-b99a-1252a93aea33 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.282257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c35e-7fa9-4938-b99a-1252a93aea33 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.282257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2c35e-7fa9-4938-b99a-1252a93aea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.306770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-4eb2c35e-7fa9-4938-b99a-1252a93aea33 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:54.307979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4eb2c35e-7fa9-4938-b99a-1252a93aea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:54.317563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:15:54.475227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3649de-9a22-423a-9fa3-d56e555cc29e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:54.492042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3649de-9a22-423a-9fa3-d56e555cc29e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:54.499273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2e7e-65fd-41e4-94d8-7b34ec3afab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:54.499930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2e7e-65fd-41e4-94d8-7b34ec3afab4 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:54.500223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2e7e-65fd-41e4-94d8-7b34ec3afab4 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:54.500505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2e7e-65fd-41e4-94d8-7b34ec3afab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:54.508998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b2e7e-65fd-41e4-94d8-7b34ec3afab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:54.510717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b2e7e-65fd-41e4-94d8-7b34ec3afab4 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:54.520875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 760/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:55.376435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98904-1c0d-446d-96c2-dc800a8f0227 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.377167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98904-1c0d-446d-96c2-dc800a8f0227 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.377167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98904-1c0d-446d-96c2-dc800a8f0227 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.378401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 17:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:15:55.384542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b0ba-a3b1-4532-834a-3a2101d8fdb6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.385364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b0ba-a3b1-4532-834a-3a2101d8fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.385640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b0ba-a3b1-4532-834a-3a2101d8fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.413327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f767b0ba-a3b1-4532-834a-3a2101d8fdb6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:55.414674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f767b0ba-a3b1-4532-834a-3a2101d8fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:55.423351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 17:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:55.572873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98904-1c0d-446d-96c2-dc800a8f0227 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:55.591135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98904-1c0d-446d-96c2-dc800a8f0227 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:55.597618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5468-3422-42c7-bf03-17a58d8c8610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:55.598268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5468-3422-42c7-bf03-17a58d8c8610 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:55.598554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5468-3422-42c7-bf03-17a58d8c8610 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:55.598832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5468-3422-42c7-bf03-17a58d8c8610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:55.607398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a5468-3422-42c7-bf03-17a58d8c8610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:55.609039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a5468-3422-42c7-bf03-17a58d8c8610 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:55.618638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 766/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:15:59.661812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816edc-1ca4-4dfd-8179-0f0729c40d83 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.662419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816edc-1ca4-4dfd-8179-0f0729c40d83 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.662419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816edc-1ca4-4dfd-8179-0f0729c40d83 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.663747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:15:59.669935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1319-91bb-41c9-9595-2926a84c50a4 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.670389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1319-91bb-41c9-9595-2926a84c50a4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.670501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1319-91bb-41c9-9595-2926a84c50a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.699462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0c1f1319-91bb-41c9-9595-2926a84c50a4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:15:59.700707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0c1f1319-91bb-41c9-9595-2926a84c50a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:59.709148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:15:59.749647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816edc-1ca4-4dfd-8179-0f0729c40d83 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:15:59.752541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a4816edc-1ca4-4dfd-8179-0f0729c40d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:15:59.817437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816edc-1ca4-4dfd-8179-0f0729c40d83 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:15:59.821983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec584-7164-4404-9f05-20ae9e9c47f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:15:59.822653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec584-7164-4404-9f05-20ae9e9c47f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:15:59.822935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec584-7164-4404-9f05-20ae9e9c47f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:15:59.823208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec584-7164-4404-9f05-20ae9e9c47f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:15:59.833369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec584-7164-4404-9f05-20ae9e9c47f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:15:59.834878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec584-7164-4404-9f05-20ae9e9c47f6 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:15:59.845329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 763/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:01.999495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101914f4-7ec1-4ace-aed3-30e7b28ccc70 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.000400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101914f4-7ec1-4ace-aed3-30e7b28ccc70 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.000400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101914f4-7ec1-4ace-aed3-30e7b28ccc70 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.002699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:16:02.009345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9f06-75cf-4dc4-b0e9-b4e7811a9657 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.010096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9f06-75cf-4dc4-b0e9-b4e7811a9657 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.010284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9f06-75cf-4dc4-b0e9-b4e7811a9657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.030441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a1fe9f06-75cf-4dc4-b0e9-b4e7811a9657 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:02.031658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a1fe9f06-75cf-4dc4-b0e9-b4e7811a9657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.040595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:02.080154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101914f4-7ec1-4ace-aed3-30e7b28ccc70 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:02.083097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-101914f4-7ec1-4ace-aed3-30e7b28ccc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:02.100257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101914f4-7ec1-4ace-aed3-30e7b28ccc70 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:02.104594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39fff7-b2cb-4458-a175-2c14c14df889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:02.105264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39fff7-b2cb-4458-a175-2c14c14df889 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:02.105547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39fff7-b2cb-4458-a175-2c14c14df889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:02.105821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39fff7-b2cb-4458-a175-2c14c14df889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:02.116023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39fff7-b2cb-4458-a175-2c14c14df889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:02.117509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39fff7-b2cb-4458-a175-2c14c14df889 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:02.127437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 769/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:06.007947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5c4a-4227-4e91-abcc-a16df78b7f30 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:06.007947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5c4a-4227-4e91-abcc-a16df78b7f30 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:06.007947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5c4a-4227-4e91-abcc-a16df78b7f30 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:06.009371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:16:06.016068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a4396-a16f-4692-a34e-a3353a5c03e9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:06.016879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a4396-a16f-4692-a34e-a3353a5c03e9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:06.017041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a4396-a16f-4692-a34e-a3353a5c03e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:06.027979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:06.044859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d64a4396-a16f-4692-a34e-a3353a5c03e9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:06.046782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d64a4396-a16f-4692-a34e-a3353a5c03e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:06.060058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:06.343038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb5c4a-4227-4e91-abcc-a16df78b7f30 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:06.345241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dbdb5c4a-4227-4e91-abcc-a16df78b7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:06.353951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=78 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:06.410844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb5c4a-4227-4e91-abcc-a16df78b7f30 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:06.414978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb08aed-9abd-4f4c-8a4e-adef74719042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:06.415650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08aed-9abd-4f4c-8a4e-adef74719042 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:06.415944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08aed-9abd-4f4c-8a4e-adef74719042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:06.416248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08aed-9abd-4f4c-8a4e-adef74719042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:06.426414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb08aed-9abd-4f4c-8a4e-adef74719042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:06.427900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb08aed-9abd-4f4c-8a4e-adef74719042 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:06.437738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 766/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:08.642138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec70253-e8bd-437d-9714-291d99b350d8 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.643026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec70253-e8bd-437d-9714-291d99b350d8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.643026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec70253-e8bd-437d-9714-291d99b350d8 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.645243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 17:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:16:08.653958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069e1b-2a1c-428e-9e0f-94175401e34a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.654896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069e1b-2a1c-428e-9e0f-94175401e34a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.655372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069e1b-2a1c-428e-9e0f-94175401e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.679647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-64069e1b-2a1c-428e-9e0f-94175401e34a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:16:08.680988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-64069e1b-2a1c-428e-9e0f-94175401e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:08.690041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:16:08.964276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec70253-e8bd-437d-9714-291d99b350d8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:16:08.966733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8ec70253-e8bd-437d-9714-291d99b350d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:16:08.982052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec70253-e8bd-437d-9714-291d99b350d8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:16:08.986140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e0450-ff5a-418e-837f-37b3adcce252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:16:08.986786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e0450-ff5a-418e-837f-37b3adcce252 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:16:08.987069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e0450-ff5a-418e-837f-37b3adcce252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:16:08.987342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e0450-ff5a-418e-837f-37b3adcce252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:16:08.996932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e0450-ff5a-418e-837f-37b3adcce252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:16:08.998376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e0450-ff5a-418e-837f-37b3adcce252 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:16:09.008096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 772/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:16:18.674013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=28 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:16:19.004106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=8 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:37.220892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.221545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.221545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.253665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:37.254878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:37.263285 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 768/1540] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:37.280776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646075-85f9-41ba-b072-b889251656ad None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.281366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646075-85f9-41ba-b072-b889251656ad None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.281366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646075-85f9-41ba-b072-b889251656ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.313970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-06646075-85f9-41ba-b072-b889251656ad None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:37.315227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-06646075-85f9-41ba-b072-b889251656ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:37.326289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 773/1541] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:37.330657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.345772 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37c9a4-45df-43d5-8b5e-99a33020e910 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.352528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.353255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.353544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.353825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.354564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:37.354879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.356680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.377610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 769/1542] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:37.385517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646075-85f9-41ba-b072-b889251656ad None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.396216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646075-85f9-41ba-b072-b889251656ad None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.405112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.406007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.406459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.406902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.407759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.409905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.457029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 774/1543] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:37.461128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.474975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bff8e-bac7-44eb-a51f-a968a4bfe197 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.562739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.563441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.563731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.564018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.564756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.566746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.595815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 770/1544] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:37.600394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.623250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dee7d-b32d-486f-bd38-5653e5b05671 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.633037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.633963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.634486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.635270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.636124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.638109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.656509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 775/1545] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:37.664941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.682630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f7953-bd02-405a-8c94-e25ddd320448 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.690292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd710649-4c96-43e2-ae80-c03f4f1e3b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.691008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd710649-4c96-43e2-ae80-c03f4f1e3b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.691300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd710649-4c96-43e2-ae80-c03f4f1e3b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.691575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd710649-4c96-43e2-ae80-c03f4f1e3b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.692322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd710649-4c96-43e2-ae80-c03f4f1e3b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.694056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd710649-4c96-43e2-ae80-c03f4f1e3b2d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.716021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 771/1546] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:37.719913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.734164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856c7a9-9427-479c-8dac-9ed3b25e1176 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:37.741001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e447c35-eca1-49d7-b4b8-d5d7e39c6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:37.741986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e447c35-eca1-49d7-b4b8-d5d7e39c6db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.742204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e447c35-eca1-49d7-b4b8-d5d7e39c6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.742503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e447c35-eca1-49d7-b4b8-d5d7e39c6db8 admin admin] PATH_INFO: `/v3/projects/9dd50da000f94eeca1c4f6ab9867d4d6/users/0429f5d2715a4487a39281edbd941fbd/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.770998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e447c35-eca1-49d7-b4b8-d5d7e39c6db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd50da000f94eeca1c4f6ab9867d4d6, user_id=0429f5d2715a4487a39281edbd941fbd, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:37.773756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e447c35-eca1-49d7-b4b8-d5d7e39c6db8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:37.802621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 776/1547] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:37 2022] PUT /identity/v3/projects/9dd50da000f94eeca1c4f6ab9867d4d6/users/0429f5d2715a4487a39281edbd941fbd/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:37.807717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.808001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.808373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.837194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:37.838422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:37.894954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047f148-938b-436c-a023-10e2239eca10 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.895316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047f148-938b-436c-a023-10e2239eca10 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.895528 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047f148-938b-436c-a023-10e2239eca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:37.934453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 772/1548] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:37.934910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c047f148-938b-436c-a023-10e2239eca10 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:37.936215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c047f148-938b-436c-a023-10e2239eca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:37.951558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:37.955599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 777/1549] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:37.971599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:37.972147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:37.972628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.017915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.019050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.043492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 778/1550] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:17:38.048143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.064856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac80f5c-69de-4c17-b6be-cbca65f7e954 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.065875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39ca7-3d90-422d-ba87-7baa425f85d6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.071174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.071864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.072143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.072417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.083071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.083781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.084068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.084350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.085137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:38.085450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.086502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:17:38.086502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:17:38.086502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:17:38.087394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.090116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.091617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.113476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 773/1551] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:17:38.115530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 779/1552] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:17:38.123764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.134563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:38.143382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1cd53-cdef-498f-8add-969876f229cd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.163693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.164392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:17:38.168633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b034038-b315-40f5-a4f5-636e169fb940 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.246947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 774/1553] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:38.253723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.287235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2b298-dfc0-4286-bc94-1b73dd8c20a5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.398220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc825-84ed-4bc4-ba21-e6cd498f0f1c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.398903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc825-84ed-4bc4-ba21-e6cd498f0f1c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.399400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc825-84ed-4bc4-ba21-e6cd498f0f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.442677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-08edc825-84ed-4bc4-ba21-e6cd498f0f1c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.448964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-08edc825-84ed-4bc4-ba21-e6cd498f0f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.457370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.458088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.458377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.458660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.459520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.460685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:17:38.460685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:17:38.460685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:17:38.461860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5baca-66f8-43dd-866f-db03ea76df9a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.468073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 775/1554] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:38.470138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.470663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.471152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.539435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 780/1555] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:38.547554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46386d8-3f04-4fd4-b0da-8516ef0621db None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.547931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46386d8-3f04-4fd4-b0da-8516ef0621db None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.548221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46386d8-3f04-4fd4-b0da-8516ef0621db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.554339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.557162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.579823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 776/1556] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:38.581778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.607173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32c7c-5834-481e-a50b-c549b7c9f68b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.625860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f46386d8-3f04-4fd4-b0da-8516ef0621db None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.627142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f46386d8-3f04-4fd4-b0da-8516ef0621db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.637525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.639729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.640004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.640335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.641238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.643185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.671441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 781/1557] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:38.672908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.673212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.673500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.676546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 777/1558] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:38.681357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.710980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447953f0-2279-4d36-8c96-4bdf5de47ccf admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.716682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.717989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.726012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.726866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.727266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.727657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.728542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:38.728977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.730695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.742981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 782/1559] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:38.743682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.771528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 778/1560] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:38.772329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.772496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755844d6-6679-42d0-a02c-984f65ac2800 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.791146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.792115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.794605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.795027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.795886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.800639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde4fd8-dc6e-4bd0-9f23-81a92c0a1807 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.806572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.821528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.822418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.822918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.823297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.824150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:38.825834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.828198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7ddc2-b31e-474e-b2bc-babb1bb1a7fb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.837372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 783/1561] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:38.838434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.853696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 779/1562] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:38.855046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771816fa-2368-4e15-87fb-37e330abbb0b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.855346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771816fa-2368-4e15-87fb-37e330abbb0b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.855630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771816fa-2368-4e15-87fb-37e330abbb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.862128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec1f1-3b53-4184-89f9-2840706a06d3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:38.877789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:38.878664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.879026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.879431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.880554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:38.882733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:38.884796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-771816fa-2368-4e15-87fb-37e330abbb0b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.886442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-771816fa-2368-4e15-87fb-37e330abbb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.903728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 780/1563] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:38.906491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c28d8-f4b6-4747-81f5-be1b32c8886f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:38.906923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c28d8-f4b6-4747-81f5-be1b32c8886f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:38.907215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c28d8-f4b6-4747-81f5-be1b32c8886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:38.929747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 784/1564] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:38.930677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:38.931254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e38c28d8-f4b6-4747-81f5-be1b32c8886f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:38.932954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e38c28d8-f4b6-4747-81f5-be1b32c8886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:38.947783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.000519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dda2f4-290e-46cd-9424-d9593911226f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.005398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 781/1565] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.007145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.007532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.007818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.011595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43b93-ab7d-4d18-8a5b-bd2bc81155ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.013190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43b93-ab7d-4d18-8a5b-bd2bc81155ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.014225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43b93-ab7d-4d18-8a5b-bd2bc81155ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.014594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43b93-ab7d-4d18-8a5b-bd2bc81155ac admin admin] PATH_INFO: `/v3/projects/744ca42b9eac4d30bb81bbf87a8f46c3/users/b776c7f39eff4fbb96e148c8975753ea/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.029396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.030736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.041484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 782/1566] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.042701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.050148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43b93-ab7d-4d18-8a5b-bd2bc81155ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=744ca42b9eac4d30bb81bbf87a8f46c3, user_id=b776c7f39eff4fbb96e148c8975753ea, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.052987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43b93-ab7d-4d18-8a5b-bd2bc81155ac admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.059400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f277b9-b608-4e0e-abe9-57c41a224121 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.064633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.065310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.065597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.065886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.066573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.068502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.070211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 785/1567] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:38 2022] PUT /identity/v3/projects/744ca42b9eac4d30bb81bbf87a8f46c3/users/b776c7f39eff4fbb96e148c8975753ea/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:39.071203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98280cd-03e7-47b0-9fc8-7c23e82ea226 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.071487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98280cd-03e7-47b0-9fc8-7c23e82ea226 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.071761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98280cd-03e7-47b0-9fc8-7c23e82ea226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.095925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f98280cd-03e7-47b0-9fc8-7c23e82ea226 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.099787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 783/1568] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.099952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f98280cd-03e7-47b0-9fc8-7c23e82ea226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.100222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.177140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 786/1569] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.178232 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.178813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff932c3-90e7-4fb0-ab8c-81ec8d073465 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.178931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff932c3-90e7-4fb0-ab8c-81ec8d073465 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.179183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff932c3-90e7-4fb0-ab8c-81ec8d073465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.188505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9de26-822c-4489-abb0-8ee9e73764a0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.195080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912644-4693-4f03-9544-e64a86ce4293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.195843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912644-4693-4f03-9544-e64a86ce4293 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.196134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912644-4693-4f03-9544-e64a86ce4293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.196514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912644-4693-4f03-9544-e64a86ce4293 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.197398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912644-4693-4f03-9544-e64a86ce4293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.197834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-2ff932c3-90e7-4fb0-ab8c-81ec8d073465 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.199031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2ff932c3-90e7-4fb0-ab8c-81ec8d073465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.199511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912644-4693-4f03-9544-e64a86ce4293 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.207259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 787/1570] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.211124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de171-096a-46e7-b505-bce1f09b030c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.211124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de171-096a-46e7-b505-bce1f09b030c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.211124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de171-096a-46e7-b505-bce1f09b030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.231292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e49de171-096a-46e7-b505-bce1f09b030c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.232108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 784/1571] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.232842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e49de171-096a-46e7-b505-bce1f09b030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.234236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.234548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.234940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.242491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 788/1572] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.244031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.244470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.245717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.258236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.260176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.270141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 785/1573] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.271011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.276753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] MFA Rules not processed for user `b776c7f39eff4fbb96e148c8975753ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.278355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.281936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604fcbc-e7e2-4a3e-a809-1e7b1f2e235a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.287167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c241-0990-42b5-90f7-16ed721102a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.287921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c241-0990-42b5-90f7-16ed721102a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.288276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c241-0990-42b5-90f7-16ed721102a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.288688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c241-0990-42b5-90f7-16ed721102a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.289476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c241-0990-42b5-90f7-16ed721102a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.291575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c241-0990-42b5-90f7-16ed721102a8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.317813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 786/1574] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.317813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669e90d-230f-466b-a776-37f3e7ab9d40 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.317813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669e90d-230f-466b-a776-37f3e7ab9d40 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.317813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669e90d-230f-466b-a776-37f3e7ab9d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.345151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8669e90d-230f-466b-a776-37f3e7ab9d40 None None] MFA Rules not processed for user `0429f5d2715a4487a39281edbd941fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.346368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8669e90d-230f-466b-a776-37f3e7ab9d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.346947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 789/1575] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.347790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.359367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab980ee-fce3-4204-94d4-946ae1ed1e6a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.363781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.364434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.364751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.365033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.365749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:39.366054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.367688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.376040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.379704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 790/1576] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:39.381015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.391971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161d7be-931d-4c9f-866f-1a1e184a4af0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.396552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.397230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.397514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.397789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.398503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:39.398812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.400422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.412186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 791/1577] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:39.413101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 787/1578] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.423365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.423523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.423523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.423523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.433327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baf72e-36d8-4091-81a8-f2c306a52cbd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.437986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.438658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.438940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.439215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.439942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.440624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.441659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.441837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.449695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 788/1579] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.451211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.452213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 792/1580] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:39.453103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.460911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2952-0d0d-4d5b-bc17-dd3e009793b0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.464055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bef16-2e61-41ff-b70a-7c6a4728e55c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.465432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.466090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.466371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.466646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.467436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:39.467741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.468753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.469404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.469513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.469727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.470000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.470685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.472275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.480868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 789/1581] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:39.487994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.488114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 793/1582] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:39.488114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.494021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29001b78-dacb-451e-b163-db1bab7e2403 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.495152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2358fdc-3cba-4332-a655-4a53af65e528 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.498763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.499413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.499696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.499969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.500678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.501165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b178c-65fc-4838-8af0-0e5e806a2b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.502325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b178c-65fc-4838-8af0-0e5e806a2b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.504035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.504184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b178c-65fc-4838-8af0-0e5e806a2b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.504184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b178c-65fc-4838-8af0-0e5e806a2b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.504184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b178c-65fc-4838-8af0-0e5e806a2b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.506344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b178c-65fc-4838-8af0-0e5e806a2b31 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.531345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 790/1583] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.532206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.539994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 794/1584] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.541369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.541742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.541940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.558526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] MFA Rules not processed for user `0429f5d2715a4487a39281edbd941fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:39.559720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:39.597718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ad3f5-c216-40ca-81b2-e61fdf104dcf admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.611571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.615327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 795/1585] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:39.617335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.668388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.669101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.669499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.669868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.670548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.672480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.703291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 791/1586] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.703291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.712108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0787989-a7f4-4aee-a431-8709df4a02b9 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.762110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81410-7d81-4d42-9f60-439378f8d15e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.763311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.767502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.768181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.768482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.768844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.769624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:39.769938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.771567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.771716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.772263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.772803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.773086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.773820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.775438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.790339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 792/1587] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:39.790339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.790646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 796/1588] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:39.790646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.801688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257937d5-3ec6-43f7-b968-5bfe161bb1fb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.801994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2d13d-8e2b-4913-ab0c-79933bbf133f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.806803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.807489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.807808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.808092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.808862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.810517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.811711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.812622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.813203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.813709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.814559 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.816587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.821828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 793/1589] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:39.822674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.832585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3b13b-5faf-45ec-88ef-f1393367422b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.837242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa2db3-717c-4e9a-a24b-cbba96bced19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.837943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa2db3-717c-4e9a-a24b-cbba96bced19 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.838262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa2db3-717c-4e9a-a24b-cbba96bced19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.838512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa2db3-717c-4e9a-a24b-cbba96bced19 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.839208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa2db3-717c-4e9a-a24b-cbba96bced19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.841199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa2db3-717c-4e9a-a24b-cbba96bced19 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.849673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 797/1590] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.852967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.865639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 794/1591] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/users => generated 300 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.867226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf72f-7121-4528-8cbe-a892558d7886 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.867590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf72f-7121-4528-8cbe-a892558d7886 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.867919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf72f-7121-4528-8cbe-a892558d7886 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.869608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 795/1592] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 17:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:17:39.870400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf72f-7121-4528-8cbe-a892558d7886 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.921324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66661-2c56-49b4-865d-4cb95355ed66 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.926318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.927041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.927326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.927603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.928296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.930324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.933635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf72f-7121-4528-8cbe-a892558d7886 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.938575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.939256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.939564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.939898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.940635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.943080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.950458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 798/1593] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.951390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.953492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.961627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4da42-5b4d-4c05-a331-505bc2338681 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.966196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.970216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 796/1594] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:39.970377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.970377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.970377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] PATH_INFO: `/v3/projects/a865909a55e644e98eac9ee2624406b4/users/0beff8a7252549eda71ed73bf5c884c3/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.970635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:39.977724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704715-ff4c-46bb-b112-bb6645945c2d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:39.982663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a865909a55e644e98eac9ee2624406b4, user_id=0beff8a7252549eda71ed73bf5c884c3, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.982864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:39.983528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:39.983819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:39.984101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:39.984822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:39.985676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.986764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:39.999276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 799/1595] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:39 2022] PUT /identity/v3/projects/a865909a55e644e98eac9ee2624406b4/users/0beff8a7252549eda71ed73bf5c884c3/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:40.000078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.023617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 797/1596] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:39 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:40.024813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.070325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d53e-7a03-4b6a-9c2f-6e002c1f3735 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.086812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1edb0e-1c99-47b9-925f-64c8f44c9fac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.091393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.092076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.092365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.092669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.093361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.095324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.111902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.117464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 798/1597] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:40.118493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.128842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed749-d198-44a7-9d4b-e525fdb734ee admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.132654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.133354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866ea6e-303c-4bfc-957c-2e2a6bc80201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.133599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.133882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.134030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ea6e-303c-4bfc-957c-2e2a6bc80201 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.134166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] PATH_INFO: `/v3/projects/6bf3f2205fe8401088d47f472e1df376/users/240dcd26a7fd45acb8c95613f45f1b5e/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.134315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ea6e-303c-4bfc-957c-2e2a6bc80201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.134578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ea6e-303c-4bfc-957c-2e2a6bc80201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.135306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866ea6e-303c-4bfc-957c-2e2a6bc80201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.136967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866ea6e-303c-4bfc-957c-2e2a6bc80201 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.149251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 799/1598] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.149251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.149251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.149251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.151827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf3f2205fe8401088d47f472e1df376, user_id=240dcd26a7fd45acb8c95613f45f1b5e, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.154575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.168632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:40.168850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 800/1599] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:39 2022] PUT /identity/v3/projects/6bf3f2205fe8401088d47f472e1df376/users/240dcd26a7fd45acb8c95613f45f1b5e/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:40.170231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:40.173476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.235512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01531d11-19b2-4c08-9c21-f1bcde4fe891 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.236838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 800/1600] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:40.237714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.240896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646fcf-c2e6-4809-accf-369f7627a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.241640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646fcf-c2e6-4809-accf-369f7627a2af admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.241933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646fcf-c2e6-4809-accf-369f7627a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.242370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646fcf-c2e6-4809-accf-369f7627a2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.243112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646fcf-c2e6-4809-accf-369f7627a2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.245153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646fcf-c2e6-4809-accf-369f7627a2af admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.247979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70229-3349-4725-a9d6-06d56d0241dd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.252443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.253135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.253422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.253699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.254427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.256028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.256266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 801/1601] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.257658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f9a6a-8445-4da4-b592-75e0ae7c3de8 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.258058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f9a6a-8445-4da4-b592-75e0ae7c3de8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.258388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f9a6a-8445-4da4-b592-75e0ae7c3de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.269601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 801/1602] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.269601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.277075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cb226-2e0a-49f9-984f-ecdb39b0cd9e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.281897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.282589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.282847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.283125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.283811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.285797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.286667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-2a4f9a6a-8445-4da4-b592-75e0ae7c3de8 None None] MFA Rules not processed for user `0beff8a7252549eda71ed73bf5c884c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:40.287910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2a4f9a6a-8445-4da4-b592-75e0ae7c3de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:40.306090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 802/1603] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:40.306970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.316304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d22150-22f3-4568-9783-14da4b5876d3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.321519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.322107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.322399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.322673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.323500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.326374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.338479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 803/1604] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.339311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.345633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.349431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e86fa1-0823-40de-b909-87e0f5d2b1ae admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.355037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.355931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.356217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.356491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] PATH_INFO: `/v3/projects/9e5db5c5e09e47f7b25f734af8c8a826/users/b2e02537cf5d49909ec56dc9163d84db/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.361624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 802/1605] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:40.363031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.363330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.363618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.371744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5db5c5e09e47f7b25f734af8c8a826, user_id=b2e02537cf5d49909ec56dc9163d84db, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.372850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:17:40.372850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:17:40.372850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:17:40.374964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.390608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 804/1606] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:40 2022] PUT /identity/v3/projects/9e5db5c5e09e47f7b25f734af8c8a826/users/b2e02537cf5d49909ec56dc9163d84db/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:40.391697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.396421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] MFA Rules not processed for user `240dcd26a7fd45acb8c95613f45f1b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:40.397709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:40.437685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.463381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 803/1607] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:40.463570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce90fd-1914-4284-a062-9802bfaf1c15 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.464150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.469585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.470729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.470729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.471071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.525645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bb1c7-ec61-4479-94ff-2a681ebbda56 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.526267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.527943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.530451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.531134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.531479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.531699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.532823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.534083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.536965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 805/1608] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:40.537754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.548335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 804/1609] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.548335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.551463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72317b2-345a-4989-9f96-453f98c011da service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.556095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d017-795d-417f-8563-068b76b3e946 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.557045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.557715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.558002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.558282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.559162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.560900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.561828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca281de8-ff8b-4cde-b580-198b97ccae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.562552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281de8-ff8b-4cde-b580-198b97ccae2e admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.562905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281de8-ff8b-4cde-b580-198b97ccae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.563186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca281de8-ff8b-4cde-b580-198b97ccae2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.563916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca281de8-ff8b-4cde-b580-198b97ccae2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.565575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca281de8-ff8b-4cde-b580-198b97ccae2e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.575618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 806/1610] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.575618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.576332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 805/1611] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.577482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bb69-5755-426a-9137-cbf156c29f40 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.577777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bb69-5755-426a-9137-cbf156c29f40 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.578024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bb69-5755-426a-9137-cbf156c29f40 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.579245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 806/1612] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 17:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:17:40.581794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bb69-5755-426a-9137-cbf156c29f40 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.589580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec761d29-0427-4717-91af-c388e3361580 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.595097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.595776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.596065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.596344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.597244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.597794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bb69-5755-426a-9137-cbf156c29f40 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.599062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.603199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.603978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.604368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.604952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.605708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.607439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.609663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 807/1613] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.610381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.620135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 807/1614] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.621193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.632474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6155a3-0fd3-4b04-bb31-35ea4065c999 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.640029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.641038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.641404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.641767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] PATH_INFO: `/v3/projects/9b1709bec893431599352cb6e470cf76/users/8c5d1f4f0bec40ad8e325f8f92739b4d/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.659989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1709bec893431599352cb6e470cf76, user_id=8c5d1f4f0bec40ad8e325f8f92739b4d, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.662930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.670943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799d61-168a-43c4-bbf4-bc2a80ce8b9c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.678832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 808/1615] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:40 2022] PUT /identity/v3/projects/9b1709bec893431599352cb6e470cf76/users/8c5d1f4f0bec40ad8e325f8f92739b4d/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:40.679733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.680424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.738612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160600a-a8f2-4fb7-9862-94547654cd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.739294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160600a-a8f2-4fb7-9862-94547654cd89 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.739588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160600a-a8f2-4fb7-9862-94547654cd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.739872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160600a-a8f2-4fb7-9862-94547654cd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.761543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c4178-6163-44aa-960e-b5b7c4d7bec1 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.767580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.769603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.769720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.769952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] PATH_INFO: `/v3/projects/5724b98399214909a99dec90c2718c44/users/8485b40daa3347d3a438c2006d9d4ef5/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.795664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5724b98399214909a99dec90c2718c44, user_id=8485b40daa3347d3a438c2006d9d4ef5, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.798450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.813963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 809/1616] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:40 2022] PUT /identity/v3/projects/5724b98399214909a99dec90c2718c44/users/8485b40daa3347d3a438c2006d9d4ef5/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:40.815142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.820573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160600a-a8f2-4fb7-9862-94547654cd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.822091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160600a-a8f2-4fb7-9862-94547654cd89 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.833757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.838438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 808/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:40.839848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.840196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.840542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.862644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:40.863976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:40.883561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a695-9382-4b54-b5a4-807e01794713 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.889159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.889968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.890349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.891118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.892024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.894228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.905230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 810/1618] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:40.909367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.920906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13db91-21a4-4a1b-948e-2cc6a675ae64 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.927409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad3590-b139-45d8-b78b-6ff14329af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:40.928360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad3590-b139-45d8-b78b-6ff14329af57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.928680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad3590-b139-45d8-b78b-6ff14329af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.928963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad3590-b139-45d8-b78b-6ff14329af57 admin admin] PATH_INFO: `/v3/projects/64e70ed32d2d4dfdb537d7d86845b9bb/users/1cefe36dc3f3496e9835f7d52fe67d8f/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.944557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 809/1619] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:40.945543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:40.946927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad3590-b139-45d8-b78b-6ff14329af57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e70ed32d2d4dfdb537d7d86845b9bb, user_id=1cefe36dc3f3496e9835f7d52fe67d8f, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:40.949956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad3590-b139-45d8-b78b-6ff14329af57 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:40.958496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc08fe-dcb6-429d-a069-1d3a5d7176b1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:40.977737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 811/1620] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:40 2022] PUT /identity/v3/projects/64e70ed32d2d4dfdb537d7d86845b9bb/users/1cefe36dc3f3496e9835f7d52fe67d8f/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:40.977737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2940a3-3fa6-43a9-87dc-679dd9564420 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:40.977737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2940a3-3fa6-43a9-87dc-679dd9564420 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:40.977737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2940a3-3fa6-43a9-87dc-679dd9564420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:40.997662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ba2940a3-3fa6-43a9-87dc-679dd9564420 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:40.998965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ba2940a3-3fa6-43a9-87dc-679dd9564420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.018913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:41.026113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e753d-e843-4004-959d-6702cfabbf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.027372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e753d-e843-4004-959d-6702cfabbf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.027977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e753d-e843-4004-959d-6702cfabbf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.028476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e753d-e843-4004-959d-6702cfabbf99 admin admin] PATH_INFO: `/v3/projects/9e5db5c5e09e47f7b25f734af8c8a826/users/b2e02537cf5d49909ec56dc9163d84db/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.032303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e753d-e843-4004-959d-6702cfabbf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5db5c5e09e47f7b25f734af8c8a826, user_id=b2e02537cf5d49909ec56dc9163d84db, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.035562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e753d-e843-4004-959d-6702cfabbf99 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.047452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 810/1621] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:40 2022] PUT /identity/v3/projects/9e5db5c5e09e47f7b25f734af8c8a826/users/b2e02537cf5d49909ec56dc9163d84db/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:41.049009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.049475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.049913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.070686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:41.071915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.072082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 812/1622] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:41.075523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a340-4786-4d29-a6f1-91eea9436217 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.075523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a340-4786-4d29-a6f1-91eea9436217 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.075523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a340-4786-4d29-a6f1-91eea9436217 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.080642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 813/1623] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 17:17:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:17:41.081578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a340-4786-4d29-a6f1-91eea9436217 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.145127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 811/1624] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:41.146605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.150581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a340-4786-4d29-a6f1-91eea9436217 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.156107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e06a-aeb8-4e24-81ac-7ae9e97c1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.157196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e06a-aeb8-4e24-81ac-7ae9e97c1059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.157665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e06a-aeb8-4e24-81ac-7ae9e97c1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.158038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e06a-aeb8-4e24-81ac-7ae9e97c1059 admin admin] PATH_INFO: `/v3/projects/becff460f58c4be7adfb2052bdf128be/users/3e168fb970b64e0e9298cebc2650049a/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.173964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e06a-aeb8-4e24-81ac-7ae9e97c1059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becff460f58c4be7adfb2052bdf128be, user_id=3e168fb970b64e0e9298cebc2650049a, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.176993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e06a-aeb8-4e24-81ac-7ae9e97c1059 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.196075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 814/1625] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:41 2022] PUT /identity/v3/projects/becff460f58c4be7adfb2052bdf128be/users/3e168fb970b64e0e9298cebc2650049a/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:41.198065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f61596-5343-4d79-8bde-0f53f917b9fa None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.198362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f61596-5343-4d79-8bde-0f53f917b9fa None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.198652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f61596-5343-4d79-8bde-0f53f917b9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.221245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:41.230636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb66f-b1a4-4b50-9705-be199cd878c5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.234799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-91f61596-5343-4d79-8bde-0f53f917b9fa None None] MFA Rules not processed for user `1cefe36dc3f3496e9835f7d52fe67d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:41.237284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-91f61596-5343-4d79-8bde-0f53f917b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.300821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd6d10-ee0b-4f91-8baa-356a192a2fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.301494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6d10-ee0b-4f91-8baa-356a192a2fba service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.301774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6d10-ee0b-4f91-8baa-356a192a2fba service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.302055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6d10-ee0b-4f91-8baa-356a192a2fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.308147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 815/1626] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:41.309620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e205-3693-48df-b336-d0557813a732 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.309825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e205-3693-48df-b336-d0557813a732 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.310087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e205-3693-48df-b336-d0557813a732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.332782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:41.339582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ec60e205-3693-48df-b336-d0557813a732 None None] MFA Rules not processed for user `b2e02537cf5d49909ec56dc9163d84db`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:41.340829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ec60e205-3693-48df-b336-d0557813a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.368550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd6d10-ee0b-4f91-8baa-356a192a2fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.369981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd6d10-ee0b-4f91-8baa-356a192a2fba service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.379512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 812/1627] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:41.380942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.381242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.381524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.403226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:41.404836 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.417453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 813/1628] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:41.422360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 816/1629] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:41.422884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.423072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e205-3693-48df-b336-d0557813a732 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.498383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e205-3693-48df-b336-d0557813a732 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.503615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446157d6-f4f1-4d79-b975-e1acd9957868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.504663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446157d6-f4f1-4d79-b975-e1acd9957868 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.505068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446157d6-f4f1-4d79-b975-e1acd9957868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.505420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446157d6-f4f1-4d79-b975-e1acd9957868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.519270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761535-b2c9-4cda-be7c-db1973c46a1b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.524799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.525495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.526026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.526322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.553858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:41.585666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446157d6-f4f1-4d79-b975-e1acd9957868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.587235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446157d6-f4f1-4d79-b975-e1acd9957868 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.617590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 817/1630] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:41.619703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.619934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.622974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.624343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.626072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.637247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 814/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:41.638153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.654957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a8af-e200-48f3-ad2f-a59dda9c6536 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.660514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.661446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.661838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.662192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.662964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.665239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.687897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] MFA Rules not processed for user `3e168fb970b64e0e9298cebc2650049a`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:41.689456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.705621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 815/1632] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:41.707739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.776986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:41.781705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06fdff-04b3-47df-a445-c8b7fc349504 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.790609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61854984-b3d8-4591-a8dc-19e1e675ccb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.791368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854984-b3d8-4591-a8dc-19e1e675ccb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.792009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854984-b3d8-4591-a8dc-19e1e675ccb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.792009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854984-b3d8-4591-a8dc-19e1e675ccb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.797575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 818/1633] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:41.797575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.797575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:41.862230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61854984-b3d8-4591-a8dc-19e1e675ccb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:41.863840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61854984-b3d8-4591-a8dc-19e1e675ccb2 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:41.874262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f50b2f-68f4-43b0-be2e-5dbff5d082f5 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:41.875074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 816/1634] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:41.878503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ef37-43c2-4afc-8e1d-b45ace6092a0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.879110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ef37-43c2-4afc-8e1d-b45ace6092a0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.879443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ef37-43c2-4afc-8e1d-b45ace6092a0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:41.881991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 817/1635] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 17:17:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:17:41.882574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ef37-43c2-4afc-8e1d-b45ace6092a0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:41.977267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:41.978286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:41.978583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:41.978865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.005378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ef37-43c2-4afc-8e1d-b45ace6092a0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.017672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c56c0-6d9a-459e-8a0f-aebb3cf75ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.018387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c56c0-6d9a-459e-8a0f-aebb3cf75ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.018681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c56c0-6d9a-459e-8a0f-aebb3cf75ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.018999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c56c0-6d9a-459e-8a0f-aebb3cf75ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.019660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c56c0-6d9a-459e-8a0f-aebb3cf75ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.021826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c56c0-6d9a-459e-8a0f-aebb3cf75ce8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.032111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:42.047214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 818/1636] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:41 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:42.051942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.052246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.052555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.079848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:42.081781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.082943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.084560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.092064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 819/1637] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:42.092991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.104127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef7a7-1687-4eb7-b37f-5ec4d0f0fe50 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.105768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 819/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:42.106847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.118371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f13ac-6676-411c-adb9-de0a5c0c4646 service glance] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.120593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.121489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.121926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.122034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] PATH_INFO: `/v3/users/b776c7f39eff4fbb96e148c8975753ea` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.123342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b776c7f39eff4fbb96e148c8975753ea)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.124235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.124650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:17:42.124650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 17:17:42.124650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: May 23 17:17:42.124924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.125024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.125420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.126166 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.126278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.127858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.151905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 820/1639] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:42.151905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.167234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378df0b-7a2c-45a1-b9ba-544e7dd8af21 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.171353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.172255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.172685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.173050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.185206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.186996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.199857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 821/1640] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:42.200765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.214407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6456-4c26-480c-80b3-a5cf224f521a service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.221622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.222886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.223600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.223863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] PATH_INFO: `/v3/projects/db6eaa97c8de4763ab1f05d3e95b8b0d/users/fab4880541b1421d9894591fd5f4891e/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.234817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b776c7f39eff4fbb96e148c8975753ea'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:42.235560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b776c7f39eff4fbb96e148c8975753ea'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:42.255130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6eaa97c8de4763ab1f05d3e95b8b0d, user_id=fab4880541b1421d9894591fd5f4891e, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.258526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.272371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b776c7f39eff4fbb96e148c8975753ea'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:42.278792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 822/1641] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:42 2022] PUT /identity/v3/projects/db6eaa97c8de4763ab1f05d3e95b8b0d/users/fab4880541b1421d9894591fd5f4891e/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:42.283348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.294766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b776c7f39eff4fbb96e148c8975753ea'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:42.295697 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98efedbf-7bb3-444d-b172-e4bd7784c064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b776c7f39eff4fbb96e148c8975753ea'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:42.304640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:42.332738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 820/1642] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:42 2022] DELETE /identity/v3/users/b776c7f39eff4fbb96e148c8975753ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:42.334659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.335822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.336327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.362574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:42.364435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.434234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a28b4-e95c-4eaa-9188-3322a8da8aff admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.439329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.439997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.440342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 821/1643] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:42.440464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.440724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.441479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.445105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.453636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.455699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.460372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 823/1644] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:42.461439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.466815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.486135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c64ff-14bb-4207-a900-8254ef6a1323 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.501659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1584ff3-9ad3-4ed0-aa30-44bd16b752db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.502695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584ff3-9ad3-4ed0-aa30-44bd16b752db admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.503028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584ff3-9ad3-4ed0-aa30-44bd16b752db admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.503315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584ff3-9ad3-4ed0-aa30-44bd16b752db admin admin] PATH_INFO: `/v3/projects/db6eaa97c8de4763ab1f05d3e95b8b0d/users/fab4880541b1421d9894591fd5f4891e/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.509661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584ff3-9ad3-4ed0-aa30-44bd16b752db admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6eaa97c8de4763ab1f05d3e95b8b0d, user_id=fab4880541b1421d9894591fd5f4891e, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.517051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584ff3-9ad3-4ed0-aa30-44bd16b752db admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.543827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 824/1645] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:42 2022] PUT /identity/v3/projects/db6eaa97c8de4763ab1f05d3e95b8b0d/users/fab4880541b1421d9894591fd5f4891e/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:42.546869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cfd34-ca33-4d6d-9edc-192ccb06025c None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.547276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cfd34-ca33-4d6d-9edc-192ccb06025c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.547637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cfd34-ca33-4d6d-9edc-192ccb06025c None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.549501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 825/1646] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 17:17:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:17:42.556261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ef7b-705c-4ba4-a258-88a3dc1474dd None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.558205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ef7b-705c-4ba4-a258-88a3dc1474dd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.559370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ef7b-705c-4ba4-a258-88a3dc1474dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.574037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee506-86b6-4acb-a9ec-3dcce86dabc3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.632962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0359ef7b-705c-4ba4-a258-88a3dc1474dd None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:42.635381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0359ef7b-705c-4ba4-a258-88a3dc1474dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.721409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:42.723551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.724975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.725947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.726832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.745872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 826/1647] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:42.747405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.747702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.748017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.787021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] MFA Rules not processed for user `fab4880541b1421d9894591fd5f4891e`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:42.787021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.847750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.849401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.856203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:42.868995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 822/1648] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:42.870585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.892728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4436d-f4dc-4fd8-8db0-9bf2f8a14cfd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:42.900001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:42.903174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:42.903861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:42.903861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:42.916949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 827/1649] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:42.922152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:42.924278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:42.929912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:42.932463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:42.954767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 823/1650] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:43.020514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:43.022135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:43.105273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1fa2-8296-4f71-8ca8-001f54e06795 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:43.135987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5619ac-4df9-4d2c-887a-77977803835c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:43.137009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5619ac-4df9-4d2c-887a-77977803835c service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:43.137369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5619ac-4df9-4d2c-887a-77977803835c service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:43.137717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5619ac-4df9-4d2c-887a-77977803835c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:43.172924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5619ac-4df9-4d2c-887a-77977803835c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:43.174538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5619ac-4df9-4d2c-887a-77977803835c service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:43.205034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 828/1651] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:17:43.290154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f9aa-ab3d-456d-b8e1-31e7a65bcf97 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:43.300638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:43.301281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:43.301685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:43.302084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:43.304638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:43.425925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:43.427944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e75ef-e470-4c06-90e9-9ddf1e855b9b service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:43.450009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 824/1652] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:17:44.166056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb20baf-f646-4a55-b57b-6c0314284d6d None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:44.166580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb20baf-f646-4a55-b57b-6c0314284d6d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:44.166790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb20baf-f646-4a55-b57b-6c0314284d6d None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:44.168356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 829/1653] 10.222.0.46 () {54 vars in 960 bytes} [Mon May 23 17:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:17:44.178613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:44.178912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:44.179191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:44.231194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:44.236046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:44.379069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb20baf-f646-4a55-b57b-6c0314284d6d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:44.401612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 825/1654] 10.222.0.46 () {58 vars in 1057 bytes} [Mon May 23 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:17:44.415956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:44.418564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb20baf-f646-4a55-b57b-6c0314284d6d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:44.430889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:44.433008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:44.433316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:44.434765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] PATH_INFO: `/v3/users/1cefe36dc3f3496e9835f7d52fe67d8f` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:44.436490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cefe36dc3f3496e9835f7d52fe67d8f)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:44.441945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:44.472839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593628b-81fc-466d-b07d-ccf4860b7f63 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:44.482835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:44.489604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:44.490936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:44.491534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:44.494098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:44.552682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:44.554427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71f7a4-54a0-4d2b-8bc5-4aa6b3003434 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:44.562315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cefe36dc3f3496e9835f7d52fe67d8f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:44.570637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 826/1655] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:44.604117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cefe36dc3f3496e9835f7d52fe67d8f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:44.666722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cefe36dc3f3496e9835f7d52fe67d8f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:44.667561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cefe36dc3f3496e9835f7d52fe67d8f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:44.669999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:44.689413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cefe36dc3f3496e9835f7d52fe67d8f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:44.703499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 830/1656] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:44 2022] DELETE /identity/v3/users/1cefe36dc3f3496e9835f7d52fe67d8f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:44.709858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:44.710337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:44.710834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:44.743626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:44.768962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:44.775650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:44.887902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 827/1657] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:44.933584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:44.935116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:45.083116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:45.085112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:45.107601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53394-81c9-45fe-9968-dae8ee30c320 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:45.111434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:45.112126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:45.112418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:45.112731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:45.113566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846d0f-a91c-4bdc-9bab-f3b0d5be2dac None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:45.151312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:45.151312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:45.151312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:45.151312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] PATH_INFO: `/v3/projects/744ca42b9eac4d30bb81bbf87a8f46c3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:45.151820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744ca42b9eac4d30bb81bbf87a8f46c3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:45.151945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:45.152075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:45.157305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:45.183269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 831/1658] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:45.259996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744ca42b9eac4d30bb81bbf87a8f46c3', 'request_id': 'req-0812bfda-7ea4-4265-b630-5a72eaab6f73'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.271106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744ca42b9eac4d30bb81bbf87a8f46c3', 'request_id': 'req-0812bfda-7ea4-4265-b630-5a72eaab6f73'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.290029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744ca42b9eac4d30bb81bbf87a8f46c3', 'request_id': 'req-0812bfda-7ea4-4265-b630-5a72eaab6f73'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.316263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] The token cache is being invalidate because project 744ca42b9eac4d30bb81bbf87a8f46c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:45.316571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.319376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.323314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 828/1659] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:45 2022] DELETE /identity/v3/projects/744ca42b9eac4d30bb81bbf87a8f46c3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:45.328009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:45.343464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31854a4-9972-4a17-9984-2336e81bae55 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:45.467371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:45.468284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:45.468563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:45.469042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] PATH_INFO: `/v3/users/b2e02537cf5d49909ec56dc9163d84db` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:45.472311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e02537cf5d49909ec56dc9163d84db)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:45.474333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:45.567979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e02537cf5d49909ec56dc9163d84db'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.583660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e02537cf5d49909ec56dc9163d84db'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.609850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e02537cf5d49909ec56dc9163d84db'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.611506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e02537cf5d49909ec56dc9163d84db'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.644052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f0b0b200-3d82-48f9-9e5f-917d79b74f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e02537cf5d49909ec56dc9163d84db'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:45.687934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 832/1660] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:45 2022] DELETE /identity/v3/users/b2e02537cf5d49909ec56dc9163d84db => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:45.994397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:45.995927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:46.035906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bfda-7ea4-4265-b630-5a72eaab6f73 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:46.264522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:46.266592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:46.267048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:46.267463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] PATH_INFO: `/v3/users/0beff8a7252549eda71ed73bf5c884c3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:46.269782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0beff8a7252549eda71ed73bf5c884c3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:46.271954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:46.341498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:46.386430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0beff8a7252549eda71ed73bf5c884c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.387733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0beff8a7252549eda71ed73bf5c884c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.444083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0beff8a7252549eda71ed73bf5c884c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.461559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0beff8a7252549eda71ed73bf5c884c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.462675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0beff8a7252549eda71ed73bf5c884c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.503828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 829/1661] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:45 2022] DELETE /identity/v3/users/0beff8a7252549eda71ed73bf5c884c3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:46.511497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:46.511912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:46.512083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:46.527089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:46.546055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:46.580049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:46.582263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:46.610782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:46.730594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce4334-8ee5-493f-b17e-7f58c4058487 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:46.733621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 833/1662] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:46.741525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:46.744593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:46.745752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:46.747774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] PATH_INFO: `/v3/projects/9e5db5c5e09e47f7b25f734af8c8a826` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:46.749416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5db5c5e09e47f7b25f734af8c8a826)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:46.751798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:46.788716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:46.790321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:46.917594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c30f7-5532-4d2e-90fe-867e8112132a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:46.928482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5db5c5e09e47f7b25f734af8c8a826', 'request_id': 'req-b64000bb-97fc-463d-8b46-8a3debc5c809'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.941812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5db5c5e09e47f7b25f734af8c8a826', 'request_id': 'req-b64000bb-97fc-463d-8b46-8a3debc5c809'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.960527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5db5c5e09e47f7b25f734af8c8a826', 'request_id': 'req-b64000bb-97fc-463d-8b46-8a3debc5c809'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.983451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] The token cache is being invalidate because project 9e5db5c5e09e47f7b25f734af8c8a826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:46.984082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.988799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64000bb-97fc-463d-8b46-8a3debc5c809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:46.993322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 830/1663] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:46 2022] DELETE /identity/v3/projects/9e5db5c5e09e47f7b25f734af8c8a826 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:47.004528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd0710-6c9f-41bd-a07c-b21d42d5e930 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.005704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd0710-6c9f-41bd-a07c-b21d42d5e930 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.006148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd0710-6c9f-41bd-a07c-b21d42d5e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.049312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-31fd0710-6c9f-41bd-a07c-b21d42d5e930 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:47.050750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-31fd0710-6c9f-41bd-a07c-b21d42d5e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:47.051563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.052454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.052996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.053583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.057232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:47.121095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:47.180757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 831/1664] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:47.184718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.185022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.185303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.215532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.218888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.224855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:47.226661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:47.242025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 834/1665] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:17:47.247765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.252118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 832/1666] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:17:47.253196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:47.253306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.273311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b94217-e8d7-4264-8da3-ca0db76cc518 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.281727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbe5fe-d138-4efa-846d-4b16698fa697 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.286574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.287311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.287599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.287880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.288650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:47.288967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.290626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.296972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.297994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.298160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.298446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] PATH_INFO: `/v3/projects/64e70ed32d2d4dfdb537d7d86845b9bb` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.301268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e70ed32d2d4dfdb537d7d86845b9bb)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.304070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: WARNING py.warnings [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 17:17:47.304070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: warnings.warn(msg) May 23 17:17:47.304070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: May 23 17:17:47.305354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.320994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 833/1667] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:47.321989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.350586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:47.350968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab37f2-41b1-4d81-be66-b0dd0c5560de admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.362045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.362756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.363046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.363329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.364046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.366396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.435215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 834/1668] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:47 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:47.436191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.443874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e70ed32d2d4dfdb537d7d86845b9bb', 'request_id': 'req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:47.476455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e70ed32d2d4dfdb537d7d86845b9bb', 'request_id': 'req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:47.524668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e70ed32d2d4dfdb537d7d86845b9bb', 'request_id': 'req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:47.542922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] The token cache is being invalidate because project 64e70ed32d2d4dfdb537d7d86845b9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:47.543494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:47.544903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:47.547592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 835/1669] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:47 2022] DELETE /identity/v3/projects/64e70ed32d2d4dfdb537d7d86845b9bb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:17:47.552518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.554531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:47.631723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef631-e518-49c4-a187-b957f6ea9f78 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.647429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.649057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.650652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.651321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.652413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.660880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.715650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 835/1670] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:47 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:47.719606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.724859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:47.742356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d135bb-80e0-42c5-b6a9-9507a4a59729 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.750206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.751601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.752089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.752565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.753637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.755648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.772046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 836/1671] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:47.778885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.793187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f22970-34fd-41ec-9620-5e982895308b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.804406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.805559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.805971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.806487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.808883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.810321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.829853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 837/1672] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:47.833992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:47.846975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5ebe-c9d4-472f-99a7-985a4d76dff2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.855339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba4c7a-2120-43e5-8d84-7bded87c8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:47.856560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba4c7a-2120-43e5-8d84-7bded87c8821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.856960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba4c7a-2120-43e5-8d84-7bded87c8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.857367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba4c7a-2120-43e5-8d84-7bded87c8821 admin admin] PATH_INFO: `/v3/projects/0383ca835b3547cd8b40b5bf71e7db3e/users/49e74562bfb54ea18e656717c1bd27eb/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.877358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba4c7a-2120-43e5-8d84-7bded87c8821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0383ca835b3547cd8b40b5bf71e7db3e, user_id=49e74562bfb54ea18e656717c1bd27eb, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:47.880590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba4c7a-2120-43e5-8d84-7bded87c8821 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:47.916907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 838/1673] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:47 2022] PUT /identity/v3/projects/0383ca835b3547cd8b40b5bf71e7db3e/users/49e74562bfb54ea18e656717c1bd27eb/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:47.925685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63da3c-ae5c-4fa4-8001-bb84d0ab076b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:47.927996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:47.928866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:47.929361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:47.968690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] MFA Rules not processed for user `49e74562bfb54ea18e656717c1bd27eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:47.970301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:48.026077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:48.152958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 839/1674] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:48.156386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:48.176753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:48.177697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:48.181090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:48.181419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] PATH_INFO: `/v3/users/fab4880541b1421d9894591fd5f4891e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:48.185004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab4880541b1421d9894591fd5f4891e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:48.191400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:48.299324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91bab-2877-4b95-8691-19a6ad986aa1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:48.300432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab4880541b1421d9894591fd5f4891e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:48.306508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:48.307568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:48.308218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:48.308904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:48.310085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:48.311844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:48.317218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:48.317377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab4880541b1421d9894591fd5f4891e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:48.345047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab4880541b1421d9894591fd5f4891e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:48.346590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab4880541b1421d9894591fd5f4891e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:48.364191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab4880541b1421d9894591fd5f4891e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:48.366322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 840/1675] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:48 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:48.370412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:48.372439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:48.378689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 836/1676] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:47 2022] DELETE /identity/v3/users/fab4880541b1421d9894591fd5f4891e => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:48.482127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c3032-a7be-48dc-be59-b3f795e60203 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:48.576251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:48.577071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:48.577552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:48.577841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:48.578602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:48.580811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:48.591208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:48.611848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 841/1677] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:48 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:17:48.615397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:48.627669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95703a-7411-4bd8-96b2-9fc0b28f60c6 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:48.653717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:48.670072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:48.671045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:48.672285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:48.673426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:48.675164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:48.701492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 837/1678] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:48.705251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:48.719289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7aee2-88a8-4938-bf07-511a32bbbdd2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:48.749635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:48.750933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:48.750933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:48.751227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] PATH_INFO: `/v3/projects/40dcd2c17e2d4407be818507eba4469e/users/fa95266fc0414c8d806bd16625797fe3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:48.801543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40dcd2c17e2d4407be818507eba4469e, user_id=fa95266fc0414c8d806bd16625797fe3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:48.804592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:48.824931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 842/1679] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:48 2022] PUT /identity/v3/projects/40dcd2c17e2d4407be818507eba4469e/users/fa95266fc0414c8d806bd16625797fe3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:48.829548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:48.847351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119ea7a-5b68-4fc3-950c-2cb649a4b14f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:48.996957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:48.997632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:48.997979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:48.998252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:48.998998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:49.000703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:49.002677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.005115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:49.021101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13fbd5-13ee-4923-a3b9-a87d8e1c2402 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:49.025732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 838/1680] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:49.028202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:49.030867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:49.031141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.031816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.032284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] PATH_INFO: `/v3/projects/a865909a55e644e98eac9ee2624406b4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.034089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a865909a55e644e98eac9ee2624406b4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:49.038052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:49.053944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58974ca5-be60-4224-8185-0c0bf7c57b9a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:49.072998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329042-21b6-4562-a4f6-bb25eb989538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:49.073943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329042-21b6-4562-a4f6-bb25eb989538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.074235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329042-21b6-4562-a4f6-bb25eb989538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.074518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329042-21b6-4562-a4f6-bb25eb989538 admin admin] PATH_INFO: `/v3/projects/40dcd2c17e2d4407be818507eba4469e/users/fa95266fc0414c8d806bd16625797fe3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.078108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329042-21b6-4562-a4f6-bb25eb989538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40dcd2c17e2d4407be818507eba4469e, user_id=fa95266fc0414c8d806bd16625797fe3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:49.081486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329042-21b6-4562-a4f6-bb25eb989538 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:49.112758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 839/1681] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:49 2022] PUT /identity/v3/projects/40dcd2c17e2d4407be818507eba4469e/users/fa95266fc0414c8d806bd16625797fe3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:49.124023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.124402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.124592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.176090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a865909a55e644e98eac9ee2624406b4', 'request_id': 'req-0820b12a-ecaf-4cca-8525-fe2b7a028bee'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.187837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] MFA Rules not processed for user `fa95266fc0414c8d806bd16625797fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:49.190180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.217630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a865909a55e644e98eac9ee2624406b4', 'request_id': 'req-0820b12a-ecaf-4cca-8525-fe2b7a028bee'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.250140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a865909a55e644e98eac9ee2624406b4', 'request_id': 'req-0820b12a-ecaf-4cca-8525-fe2b7a028bee'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.282410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] The token cache is being invalidate because project a865909a55e644e98eac9ee2624406b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:49.282709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.287878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0820b12a-ecaf-4cca-8525-fe2b7a028bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.294864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 843/1682] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:48 2022] DELETE /identity/v3/projects/a865909a55e644e98eac9ee2624406b4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:49.301699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fdc98-6203-4ed5-847d-6abe7ed8608a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.301990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fdc98-6203-4ed5-847d-6abe7ed8608a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.303875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fdc98-6203-4ed5-847d-6abe7ed8608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.366013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1a2fdc98-6203-4ed5-847d-6abe7ed8608a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:49.367936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1a2fdc98-6203-4ed5-847d-6abe7ed8608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.371571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 840/1683] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:17:49.383794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:49.385999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.456044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:49.530280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7195-1a86-4a9f-9b53-87e199033ddc None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:49.539933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 844/1684] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:49.547302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.547479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:49.547917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.548258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.548362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.548630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.549639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.577385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:49.578876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:49.593539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:49.596926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.603735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 841/1685] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:49.622526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 845/1686] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:49.623633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:49.624087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:49.625161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.650375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7ed8d-6ae1-4a0d-89c1-92c260699d60 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:49.666090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:49.667189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.667449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.668071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] PATH_INFO: `/v3/projects/db6eaa97c8de4763ab1f05d3e95b8b0d` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.669832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6eaa97c8de4763ab1f05d3e95b8b0d)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:49.675332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:49.697188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedccf08-c8e9-4745-944f-9e55f2481f01 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:49.734550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:49.735525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.738884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.739193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.743352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:49.743686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:49.750713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:49.792692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 846/1687] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:49.795552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:49.832980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6eaa97c8de4763ab1f05d3e95b8b0d', 'request_id': 'req-0890f737-8320-4ac7-addb-e12183f06da9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.842051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754703f3-057f-4c51-b559-ea69a845e29f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:49.850826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6eaa97c8de4763ab1f05d3e95b8b0d', 'request_id': 'req-0890f737-8320-4ac7-addb-e12183f06da9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.865823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6eaa97c8de4763ab1f05d3e95b8b0d', 'request_id': 'req-0890f737-8320-4ac7-addb-e12183f06da9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.887859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] The token cache is being invalidate because project db6eaa97c8de4763ab1f05d3e95b8b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:49.888867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.894065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0890f737-8320-4ac7-addb-e12183f06da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:49.897447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 842/1688] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:49 2022] DELETE /identity/v3/projects/db6eaa97c8de4763ab1f05d3e95b8b0d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:49.901852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ff6a-fc43-44ff-91cd-bb6ed159391b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:49.902819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ff6a-fc43-44ff-91cd-bb6ed159391b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:49.903295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ff6a-fc43-44ff-91cd-bb6ed159391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:49.940225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-63c9ff6a-fc43-44ff-91cd-bb6ed159391b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:49.942090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-63c9ff6a-fc43-44ff-91cd-bb6ed159391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:49.965418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:50.120309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 843/1689] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:17:50.128229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.128538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.128916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:50.172432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:50.176645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.178466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.178603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:50.184511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:50.194010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:50.283526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:50.289777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:50.323612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 844/1690] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:50.328265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 847/1691] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:49 2022] POST /identity/v3/projects => generated 391 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:50.329394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:50.330032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:50.332622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:50.432252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02243a88-d346-4e99-84d0-8238e06c09a1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:50.511487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808fc2b-cd71-45d0-beb9-d5096876b61e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:50.543074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:50.544937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.547706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.548164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:50.549998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:50.552430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:50.557862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:50.593807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 848/1692] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:50.595552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:50.597081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:50.624558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308ad28-4674-4954-a2c3-2d8bfabba193 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:50.635937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:50.638880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.641067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.641754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:50.643129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:50.651460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:50.651688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:50.653075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.653368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.655053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:50.656482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:50.661965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:50.711003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 849/1693] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:50 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:50.714445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 845/1694] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:50 2022] POST /identity/v3/users => generated 296 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:50.718817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:50.719985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:50.817063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1614-08dd-4be5-94ae-6bc2bfe8316f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:50.957713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d4fd3-6b70-4128-9a1c-93b3781afbdd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:50.964161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:50.964954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.965568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.965568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:50.967649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:50.972838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:50.980661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:50.981491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:50.994517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:50.996827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.000100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.007456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.040440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 850/1695] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:51.041437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.041689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 846/1696] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:50 2022] POST /identity/v3/users => generated 284 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:51.046546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.068961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5453-a813-47ed-8985-8dd3311f7c4f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:51.074367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010756-2836-4d74-9e88-9750b8ec0d31 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:51.084928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:51.086510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.086668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.087098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.087868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.088208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffd6c8-9eba-45fb-aaf2-04c7dfcfbddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:51.088942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffd6c8-9eba-45fb-aaf2-04c7dfcfbddd admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.089227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffd6c8-9eba-45fb-aaf2-04c7dfcfbddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.089523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffd6c8-9eba-45fb-aaf2-04c7dfcfbddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.089729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.090389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffd6c8-9eba-45fb-aaf2-04c7dfcfbddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.093101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffd6c8-9eba-45fb-aaf2-04c7dfcfbddd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.126249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 851/1697] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:51.130166 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.130479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.130763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.136386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 847/1698] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:51.139793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.167013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a47602-d227-4f5e-b691-2da833123635 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:51.177602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:51.179001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:51.185327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:51.186727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.187028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.187316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] PATH_INFO: `/v3/projects/3eec6abebcf24066a797847261b253f2/users/d690647ea0e34d30a2bb30dd74b44779/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.202412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:51.221633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eec6abebcf24066a797847261b253f2, user_id=d690647ea0e34d30a2bb30dd74b44779, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.234211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.307774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 848/1699] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:51 2022] PUT /identity/v3/projects/3eec6abebcf24066a797847261b253f2/users/d690647ea0e34d30a2bb30dd74b44779/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:51.308701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.340431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 852/1700] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:17:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:51.344311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.350321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:51.430677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0bab-1e7a-42a2-99bb-bb74a813b34b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:51.519661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a81c-ec2b-48f4-84af-6a66eb5ae2e5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:51.533956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b844c-5a2f-4660-9324-8af4cdd9e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:51.537281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b844c-5a2f-4660-9324-8af4cdd9e4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.537638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b844c-5a2f-4660-9324-8af4cdd9e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.537927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b844c-5a2f-4660-9324-8af4cdd9e4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.539952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b844c-5a2f-4660-9324-8af4cdd9e4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.553188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b844c-5a2f-4660-9324-8af4cdd9e4c9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.593874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 849/1701] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:51.597600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.598904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.599411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.615260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:51.616532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.616848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.619897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] PATH_INFO: `/v3/users/49e74562bfb54ea18e656717c1bd27eb` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.625905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e74562bfb54ea18e656717c1bd27eb)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.629491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.670778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] MFA Rules not processed for user `d690647ea0e34d30a2bb30dd74b44779`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:51.672003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:51.715640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:51.788201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e74562bfb54ea18e656717c1bd27eb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:51.792569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e74562bfb54ea18e656717c1bd27eb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:51.832289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e74562bfb54ea18e656717c1bd27eb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:51.844589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e74562bfb54ea18e656717c1bd27eb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:51.847530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e74562bfb54ea18e656717c1bd27eb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:51.854822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 850/1702] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:51.857845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.882028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ea40-a41b-473a-a00b-c9c79d679d1b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:51.886778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:51.887697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:51.887982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:51.888809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] PATH_INFO: `/v3/projects/409f36960f7347de8b4649a3b609c4a4/users/c91c87583a6c4b0db51595707364f512/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:51.916584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 853/1703] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:51 2022] DELETE /identity/v3/users/49e74562bfb54ea18e656717c1bd27eb => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:51.918117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] RBAC: Authorizing `identity:create_grant(project_id=409f36960f7347de8b4649a3b609c4a4, user_id=c91c87583a6c4b0db51595707364f512, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:51.919331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.921766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:51.925594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:51.952672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 851/1704] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:51 2022] PUT /identity/v3/projects/409f36960f7347de8b4649a3b609c4a4/users/c91c87583a6c4b0db51595707364f512/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:51.962141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:51.964209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:52.092674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:52.118315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b5f4-90a6-4256-a3b1-9126df63017b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:52.145533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52166ee4-f77c-4d80-ad20-85360138042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:52.146253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52166ee4-f77c-4d80-ad20-85360138042a admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.146542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52166ee4-f77c-4d80-ad20-85360138042a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.146826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52166ee4-f77c-4d80-ad20-85360138042a admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.147543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52166ee4-f77c-4d80-ad20-85360138042a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:52.149541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52166ee4-f77c-4d80-ad20-85360138042a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:52.160670 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fc97-f0b9-4026-a542-31cbed9ce265 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:52.214615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 852/1705] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:51 2022] POST /identity/v3/projects => generated 393 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:52.217678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4234-1bb5-421a-a968-b32fb9e0ee0a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.217996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4234-1bb5-421a-a968-b32fb9e0ee0a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.218285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4234-1bb5-421a-a968-b32fb9e0ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.269425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-218a4234-1bb5-421a-a968-b32fb9e0ee0a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:52.271226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-218a4234-1bb5-421a-a968-b32fb9e0ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:52.285521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:52.286202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.286490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.286764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.288919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:52.392533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 853/1706] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:52.394104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e7540-e582-44e0-a9d1-5d81a15522ef None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.394401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e7540-e582-44e0-a9d1-5d81a15522ef None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.394827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e7540-e582-44e0-a9d1-5d81a15522ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.399684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:52.405710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:52.418568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 854/1707] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:17:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:17:52.423112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:52.445715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd885be-7fee-47db-b1dc-85c945e86ac6 service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:52.461161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:52.462218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.462714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.463168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.467924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:52.497567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:52.559456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-073e7540-e582-44e0-a9d1-5d81a15522ef None None] MFA Rules not processed for user `c91c87583a6c4b0db51595707364f512`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:52.564358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-073e7540-e582-44e0-a9d1-5d81a15522ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:52.584213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 855/1708] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:52 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:52.586916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:52.587673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:52.594370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:52.856316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 854/1709] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:52.856316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.858964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.858964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.912416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9792ce-ba07-45ab-9fd1-297016b49990 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:52.933553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:52.934561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:52.934725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:52.935116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:52.959513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] MFA Rules not processed for user `8485b40daa3347d3a438c2006d9d4ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:52.960864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:52.960987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:52.962402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.002015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 856/1710] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:53.002952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.035435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cedd0-c325-41e8-aeee-10f60b30bf0b service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.059660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:53.061526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.061824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.062113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.062897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:53.071217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.082749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:53.114238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 857/1711] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:53.115260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.117061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:53.151893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20d46-34ca-4e4c-840a-16def73c7d27 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.161116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 855/1712] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:53.163494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.167070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:53.167790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.168096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.168555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.169555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:53.171158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:53.171631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.222521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c00f06-e8e5-4ed4-a639-567bec3fb2b6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.233055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 858/1713] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:53 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:53.234396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.236867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:53.241636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.244239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.246225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] PATH_INFO: `/v3/users/3e168fb970b64e0e9298cebc2650049a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.254137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e168fb970b64e0e9298cebc2650049a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:53.265027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.375591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb06e3-2f2a-4cf4-b8e5-7b5eb96eb3ec admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.389354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:53.390311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.390598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.390887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] PATH_INFO: `/v3/projects/4a5ff0c81d9c4eb69dccc17f0f7dc367/users/70549157ce6342969918dd53f55de67b/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.401101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e168fb970b64e0e9298cebc2650049a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:53.450440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e168fb970b64e0e9298cebc2650049a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:53.460525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5ff0c81d9c4eb69dccc17f0f7dc367, user_id=70549157ce6342969918dd53f55de67b, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:53.463656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.509355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e168fb970b64e0e9298cebc2650049a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:53.510091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 859/1714] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:53 2022] PUT /identity/v3/projects/4a5ff0c81d9c4eb69dccc17f0f7dc367/users/70549157ce6342969918dd53f55de67b/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:53.511181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.512195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e168fb970b64e0e9298cebc2650049a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:53.529331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:53.546720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e168fb970b64e0e9298cebc2650049a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:53.564657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 856/1715] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:53 2022] DELETE /identity/v3/users/3e168fb970b64e0e9298cebc2650049a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:53.565417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.572347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:53.601648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:53.698430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb1576-bc50-45da-bdf4-29fcaefcdb82 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.712020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:53.714254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.714254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.714254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.714490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:53.719239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.782625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 857/1716] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:53 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:53.809521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:53.821209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:53.827661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e17c-aa4a-441d-8bf8-e0c778bd2028 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.870953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166895d9-9ca0-4c59-bd31-c6a8567bbce1 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:53.882925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff7209-2d21-4b6b-a7e3-04dbc05cb063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:53.892096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff7209-2d21-4b6b-a7e3-04dbc05cb063 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.892503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff7209-2d21-4b6b-a7e3-04dbc05cb063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.892824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff7209-2d21-4b6b-a7e3-04dbc05cb063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.897909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff7209-2d21-4b6b-a7e3-04dbc05cb063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:53.903454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff7209-2d21-4b6b-a7e3-04dbc05cb063 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:53.948919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 858/1717] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:53.958943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:53.959593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:53.959593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:53.990471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:54.035438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:54.037475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:54.043386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:54.044134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.044389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.044951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.053533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:54.060721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 859/1718] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:54.061257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:54.090607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46f929-1ac0-435c-a29d-176110ec9d13 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:54.105195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:54.107504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.107995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.109058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.110599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:54.113649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:54.157930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 860/1719] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:54.167670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:54.200042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329ac0-74a0-472d-93e4-ecd48374feaf admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:54.213770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:54.219354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.219766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.220066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] PATH_INFO: `/v3/projects/4a5ff0c81d9c4eb69dccc17f0f7dc367/users/70549157ce6342969918dd53f55de67b/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.225237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5ff0c81d9c4eb69dccc17f0f7dc367, user_id=70549157ce6342969918dd53f55de67b, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:54.230925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:54.275133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 861/1720] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:54 2022] PUT /identity/v3/projects/4a5ff0c81d9c4eb69dccc17f0f7dc367/users/70549157ce6342969918dd53f55de67b/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:54.285379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:54.285534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:54.285636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:54.285734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:54.317884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 860/1721] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:54.320580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:54.326240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:54.362734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ba3d6-aae9-4fd9-8039-e5f49b2b98a3 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:54.445558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4598f7-2d6e-4391-8cb7-8f777360fd94 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:54.451909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:54.453492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.454416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.454695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.594872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:54.597458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:54.614642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 862/1722] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:54.615536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:54.625768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:54.626695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.626981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.627265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] PATH_INFO: `/v3/projects/0383ca835b3547cd8b40b5bf71e7db3e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.630987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0383ca835b3547cd8b40b5bf71e7db3e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:54.632481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b039f-61af-4e30-a2f5-8dbd7a38331d service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:54.634206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:54.655850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab511-c5ec-4d90-93cc-d017cf4d8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:54.658400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab511-c5ec-4d90-93cc-d017cf4d8f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.659607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab511-c5ec-4d90-93cc-d017cf4d8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.659889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab511-c5ec-4d90-93cc-d017cf4d8f32 admin admin] PATH_INFO: `/v3/projects/51cd4aa340524feeb02a400b403204e2/users/91d131bbf6e24290956d7f383c010dbf/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.664685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:54.722294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab511-c5ec-4d90-93cc-d017cf4d8f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cd4aa340524feeb02a400b403204e2, user_id=91d131bbf6e24290956d7f383c010dbf, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:54.730854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab511-c5ec-4d90-93cc-d017cf4d8f32 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:54.785824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 863/1723] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:54 2022] PUT /identity/v3/projects/51cd4aa340524feeb02a400b403204e2/users/91d131bbf6e24290956d7f383c010dbf/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:54.787505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:54.787799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:54.790824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:54.816921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0383ca835b3547cd8b40b5bf71e7db3e', 'request_id': 'req-696ed746-1b6d-442d-b516-5d75b1e88265'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:54.830902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0383ca835b3547cd8b40b5bf71e7db3e', 'request_id': 'req-696ed746-1b6d-442d-b516-5d75b1e88265'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:54.867515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0383ca835b3547cd8b40b5bf71e7db3e', 'request_id': 'req-696ed746-1b6d-442d-b516-5d75b1e88265'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:54.895068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] MFA Rules not processed for user `70549157ce6342969918dd53f55de67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:54.899511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:54.912327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] The token cache is being invalidate because project 0383ca835b3547cd8b40b5bf71e7db3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:54.912969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:54.915626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:54.922323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 861/1724] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:54 2022] DELETE /identity/v3/projects/0383ca835b3547cd8b40b5bf71e7db3e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:54.924196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:54.929193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:55.042774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:55.211756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed746-1b6d-442d-b516-5d75b1e88265 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:55.228748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 864/1725] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:55.231305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:55.239501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:55.247031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28592-7d5b-404f-b659-f51b254d2308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:55.249268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28592-7d5b-404f-b659-f51b254d2308 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:55.249830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28592-7d5b-404f-b659-f51b254d2308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:55.251434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28592-7d5b-404f-b659-f51b254d2308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:55.253139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28592-7d5b-404f-b659-f51b254d2308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:55.261803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28592-7d5b-404f-b659-f51b254d2308 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:55.295642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 862/1726] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:17:55.297634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:55.298595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:55.299364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:55.306594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f8c8-a3b2-460e-937d-5d4b5e05052f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:55.328335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:55.332649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:55.333040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:55.333221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] PATH_INFO: `/v3/users/fa95266fc0414c8d806bd16625797fe3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:55.346552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa95266fc0414c8d806bd16625797fe3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:55.356854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:55.359571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:55.362617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:55.567413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa95266fc0414c8d806bd16625797fe3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:55.573792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 863/1727] 10.222.0.50 () {58 vars in 1015 bytes} [Mon May 23 17:17:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:55.575727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:55.580588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:55.590447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa95266fc0414c8d806bd16625797fe3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:55.652552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa95266fc0414c8d806bd16625797fe3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:55.654893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa95266fc0414c8d806bd16625797fe3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:55.689550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa95266fc0414c8d806bd16625797fe3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:55.718061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 865/1728] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:55 2022] DELETE /identity/v3/users/fa95266fc0414c8d806bd16625797fe3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:55.723954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:55.736953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:55.877665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dd4ac-3243-48d9-95a0-a09d198db82c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:56.057878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:56.200504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934bbe5-8a13-4aa5-9835-14f29f08a5ab admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:56.217271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:56.219953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:56.220588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:56.221045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] PATH_INFO: `/v3/projects/51cd4aa340524feeb02a400b403204e2/users/91d131bbf6e24290956d7f383c010dbf/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:56.222932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:56.223883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:56.224261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:56.225930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:56.230033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:56.236656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cd4aa340524feeb02a400b403204e2, user_id=91d131bbf6e24290956d7f383c010dbf, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:56.251624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:56.310929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 866/1729] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:17:55 2022] PUT /identity/v3/projects/51cd4aa340524feeb02a400b403204e2/users/91d131bbf6e24290956d7f383c010dbf/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:56.312433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:56.325252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:56.432950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:56.510525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:56.528693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e989db5-48b4-4be4-8547-31368c36a270 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:56.562710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05240ca-c308-4af4-b27b-391e9e341127 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:56.579575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:56.580285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:56.581048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 864/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 1006 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:56.582624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:56.582919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:56.583198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:56.584239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:56.585944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:56.594124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:56.629286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:56.630816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:56.665250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 867/1731] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:56.666221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:56.674176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:56.689638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] MFA Rules not processed for user `91d131bbf6e24290956d7f383c010dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:56.690919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:56.888880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413e0e-e66e-4ea3-8b4e-63af611a82e8 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:56.914340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:56.915355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:56.915637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:56.915917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] PATH_INFO: `/v3/users/240dcd26a7fd45acb8c95613f45f1b5e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:56.919367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240dcd26a7fd45acb8c95613f45f1b5e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:56.925486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:56.936344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 865/1732] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:56.937387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:56.942201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:57.005823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d14978-9fa9-44b9-9b85-bc15b5773b85 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:57.037825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240dcd26a7fd45acb8c95613f45f1b5e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.042186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:57.043535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:57.044239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:57.046503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] PATH_INFO: `/v3/projects/becff460f58c4be7adfb2052bdf128be` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:57.050963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=becff460f58c4be7adfb2052bdf128be)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:57.051749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240dcd26a7fd45acb8c95613f45f1b5e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.058631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:57.083743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240dcd26a7fd45acb8c95613f45f1b5e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.084813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240dcd26a7fd45acb8c95613f45f1b5e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.100768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:57.112507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240dcd26a7fd45acb8c95613f45f1b5e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.125364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 868/1733] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:17:56 2022] DELETE /identity/v3/users/240dcd26a7fd45acb8c95613f45f1b5e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:57.126254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:57.128821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:57.274775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b6ea9-0eba-433e-98af-58577f218624 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:57.360163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becff460f58c4be7adfb2052bdf128be', 'request_id': 'req-046dfa81-392a-4b9f-81b0-36c8942413bd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.396146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:57.397020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:57.397414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:57.397857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:57.399979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:57.400416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becff460f58c4be7adfb2052bdf128be', 'request_id': 'req-046dfa81-392a-4b9f-81b0-36c8942413bd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.417129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becff460f58c4be7adfb2052bdf128be', 'request_id': 'req-046dfa81-392a-4b9f-81b0-36c8942413bd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.461111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] The token cache is being invalidate because project becff460f58c4be7adfb2052bdf128be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:57.467384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.470002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:57.487183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 866/1734] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:56 2022] DELETE /identity/v3/projects/becff460f58c4be7adfb2052bdf128be => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:57.488265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:57.489904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:57.560916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dfa81-392a-4b9f-81b0-36c8942413bd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:57.585664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:57.586370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:57.586668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:57.587129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:57.590029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:57.590922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:57.593512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:57.626499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 869/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:57.630725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:57.634140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:57.798058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:57.817205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5458-6a10-4715-9926-8a1d78331b2f service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:57.831519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:57.832111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:57.832486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:57.832826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] PATH_INFO: `/v3/projects/40dcd2c17e2d4407be818507eba4469e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:57.838786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=40dcd2c17e2d4407be818507eba4469e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:57.849599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:57.881573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:57.945715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:57.958237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc044c-578b-4acf-bedc-571a02407c36 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:58.006439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 867/1736] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:58.008787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90239e-78a6-43ca-84d2-82e378034102 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.016557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90239e-78a6-43ca-84d2-82e378034102 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.017057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90239e-78a6-43ca-84d2-82e378034102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.028906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40dcd2c17e2d4407be818507eba4469e', 'request_id': 'req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:58.064806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40dcd2c17e2d4407be818507eba4469e', 'request_id': 'req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:58.083931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40dcd2c17e2d4407be818507eba4469e', 'request_id': 'req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:58.099459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fb90239e-78a6-43ca-84d2-82e378034102 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:58.105317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fb90239e-78a6-43ca-84d2-82e378034102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.127136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] The token cache is being invalidate because project 40dcd2c17e2d4407be818507eba4469e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:17:58.132290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:58.143469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-abf4d08b-183a-434c-8fbf-7dbcf44b61fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:17:58.146772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 870/1737] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:17:57 2022] DELETE /identity/v3/projects/40dcd2c17e2d4407be818507eba4469e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:17:58.148201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de335580-f540-4001-b2ec-d285a61d082c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.148489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de335580-f540-4001-b2ec-d285a61d082c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.148831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de335580-f540-4001-b2ec-d285a61d082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.244875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-de335580-f540-4001-b2ec-d285a61d082c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:58.246156 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-de335580-f540-4001-b2ec-d285a61d082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.365477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 868/1738] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:58.371356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.372254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.372852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.436047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 871/1739] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:58.437457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afad56-d71f-452c-836d-4e75c1ed7a1b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.437758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afad56-d71f-452c-836d-4e75c1ed7a1b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.450610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afad56-d71f-452c-836d-4e75c1ed7a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.479073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] MFA Rules not processed for user `8c5d1f4f0bec40ad8e325f8f92739b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:58.480742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.512034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-16afad56-d71f-452c-836d-4e75c1ed7a1b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:58.516637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-16afad56-d71f-452c-836d-4e75c1ed7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.548767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 872/1740] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:58.550224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f661d-250c-4f5e-9111-7ae611f5ed4e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.550518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f661d-250c-4f5e-9111-7ae611f5ed4e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.550796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f661d-250c-4f5e-9111-7ae611f5ed4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.608797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-384f661d-250c-4f5e-9111-7ae611f5ed4e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:58.612327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-384f661d-250c-4f5e-9111-7ae611f5ed4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.650445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 873/1741] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:58.664000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.665876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.668791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.760743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 869/1742] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:58.761606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:58.762370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:58.764038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.807284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 874/1743] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:58.807789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:58.828228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:58.854448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add14e7e-b815-401f-9411-dddf7d833096 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:58.867544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:58.868252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.868580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.878052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.879322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:58.879322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:58.880951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1316bfc-e853-464e-9f76-45cd6ed3b4e6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:58.937261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 870/1744] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:58.944227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.944557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.944828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:58.968589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da595e-8943-41c0-b37f-98767a141899 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:58.981432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:58.982161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:58.984829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:58.984829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:59.021858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:59.023460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:59.031205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] MFA Rules not processed for user `8c5d1f4f0bec40ad8e325f8f92739b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:17:59.041537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:59.046842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 875/1745] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:59.049480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.057096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 871/1746] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:17:59.057862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.079659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa66c0-0ea5-4ffe-b3ac-7ec2c9d16fae service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:59.087169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8bb19-b8ae-4b4d-99b9-6bc0e3f76b25 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:59.092809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:59.093520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:59.093809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:59.094092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:59.095096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:17:59.095240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:59.101322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:59.105127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:59.105831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:59.106430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:59.106724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:59.107486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:59.109502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:59.140222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 876/1747] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:17:59.143901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.150685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:17:59.169474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 872/1748] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:59 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:59.170345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.192337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:59.260445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:59.347530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161659-d070-4a14-96dc-2939cf1c7919 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:59.398518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d49a-7cc3-4cf6-a6c7-f0826b86e71f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:59.417369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:59.418870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:59.421011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:59.421117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:59.425501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:59.433636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:59.565791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 873/1749] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:17:59 2022] POST /identity/v3/projects => generated 373 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:59.572994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.580425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:59.583368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:59.584262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:59.584549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:59.725467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:59.727554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:59.766625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 877/1750] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:17:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:17:59.767646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.817953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6c9b-8763-46d9-ab4a-e2e1875c925b service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:59.876517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764f824-b983-4c3e-b61e-5ef3bde74ae6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:17:59.897049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:17:59.897949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:17:59.899977 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:17:59.900396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:17:59.901317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:17:59.913438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:17:59.965074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 874/1751] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:59 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:17:59.965250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:59.967380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:17:59.991643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72c2b6-5cfd-4ab3-b8e1-7e248394f867 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:00.009579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.010286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.010561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.010887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.011774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.014495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.031588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.032579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.032729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 875/1752] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:00.033183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.033262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.033602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:00.033940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.036309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.049911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0ebde-d762-4512-911d-df5630b20a01 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:00.064666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.066974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.069498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.070402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.073854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.079549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.110850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 878/1753] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:17:59 2022] POST /identity/v3/users => generated 287 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:00.118072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:00.126964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 876/1754] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:00.128336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:00.155456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30139d-5f4d-4d71-8b69-8394f12b202b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:00.169565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9bba2-209a-407b-b5ed-35ad433e25e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.171138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9bba2-209a-407b-b5ed-35ad433e25e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.171138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9bba2-209a-407b-b5ed-35ad433e25e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.171557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9bba2-209a-407b-b5ed-35ad433e25e4 admin admin] PATH_INFO: `/v3/projects/95f843d7f5e34140b3a56366f170528f/users/5d786c2bc1a546cb88524bf03a49938c/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.175815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38805123-13e0-49bd-a42a-50703b2b9a1f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:00.201938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.203020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.203614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.203815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.204548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.206380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.239048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9bba2-209a-407b-b5ed-35ad433e25e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f843d7f5e34140b3a56366f170528f, user_id=5d786c2bc1a546cb88524bf03a49938c, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.244235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 879/1755] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:00.250621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:00.254910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9bba2-209a-407b-b5ed-35ad433e25e4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.295977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e06a1b-46a1-4851-9654-3143d7ad7408 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:00.304773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 877/1756] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:00 2022] PUT /identity/v3/projects/95f843d7f5e34140b3a56366f170528f/users/5d786c2bc1a546cb88524bf03a49938c/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:00.316291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d705b12-99f6-45c5-9f35-d4a34fdefcf0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.325234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d705b12-99f6-45c5-9f35-d4a34fdefcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.325755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d705b12-99f6-45c5-9f35-d4a34fdefcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.488236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2d705b12-99f6-45c5-9f35-d4a34fdefcf0 None None] MFA Rules not processed for user `5d786c2bc1a546cb88524bf03a49938c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:00.514463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2d705b12-99f6-45c5-9f35-d4a34fdefcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:00.552119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.552865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.553153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.553543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.554377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.556101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.605750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 880/1757] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:00.607080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:00.626721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6d09-8e88-45fe-a964-335fba01f8b9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:00.637087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:00.638102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.638847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.639125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] PATH_INFO: `/v3/projects/811b15b0bb0048b28700714556dde299/users/40c00c0bcb534a5a969bff4651cef40c/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.681497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b15b0bb0048b28700714556dde299, user_id=40c00c0bcb534a5a969bff4651cef40c, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:00.684523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:00.716539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:00.735618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 881/1758] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:00 2022] PUT /identity/v3/projects/811b15b0bb0048b28700714556dde299/users/40c00c0bcb534a5a969bff4651cef40c/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:00.735618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:00.739856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:00.803865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 878/1759] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:00.810536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:00.811050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:00.811544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:00.857854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:00.868588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:00.988985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa2593-e90c-42a8-ab1c-814aa80342ce admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:01.011998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:01.013008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.013754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.014001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] PATH_INFO: `/v3/projects/6bf3f2205fe8401088d47f472e1df376` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.015490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf3f2205fe8401088d47f472e1df376)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:01.020271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:01.164814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 879/1760] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:01.166072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:01.176105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:01.189610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:01.241336 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf3f2205fe8401088d47f472e1df376', 'request_id': 'req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:01.264424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf3f2205fe8401088d47f472e1df376', 'request_id': 'req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:01.290456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf3f2205fe8401088d47f472e1df376', 'request_id': 'req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:01.330394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] The token cache is being invalidate because project 6bf3f2205fe8401088d47f472e1df376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:01.330755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:01.335042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-226e6fa3-2ded-4cce-8ebe-8f8385efcc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:01.342412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 882/1761] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:00 2022] DELETE /identity/v3/projects/6bf3f2205fe8401088d47f472e1df376 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:01.345063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e99155-473f-4ca0-97fa-edfdc88ffb9a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:01.347279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.347590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.347866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.439808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:01.440735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] MFA Rules not processed for user `8485b40daa3347d3a438c2006d9d4ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:01.440860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.443658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.445242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.447690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:01.450565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:01.513260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:01.620880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:01.631162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 883/1762] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:01.631162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:01.631639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c38ff4-2ebf-4e10-8480-fbbf4a171036 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:01.633699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:01.664585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 880/1763] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:01.693297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6d7b-02ea-4c57-a0b1-7da75504b935 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.693894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6d7b-02ea-4c57-a0b1-7da75504b935 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.695562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6d7b-02ea-4c57-a0b1-7da75504b935 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.719122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 881/1764] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:18:01 2022] GET /identity => generated 270 bytes in 41 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:18:01.722951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9797f-458d-419e-8042-86b190e9239f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.724623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9797f-458d-419e-8042-86b190e9239f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.725126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9797f-458d-419e-8042-86b190e9239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.776728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2f82-6701-43f6-b4a9-6c6c5f6b7a14 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:01.783219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5cd9797f-458d-419e-8042-86b190e9239f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:01.785344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:01.786040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.786333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.786604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.795057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5cd9797f-458d-419e-8042-86b190e9239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:01.798242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:01.927134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 882/1765] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:01.931627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c791-a9b6-4e64-a0ac-04d83b2c0714 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:01.932988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c791-a9b6-4e64-a0ac-04d83b2c0714 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:01.933122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c791-a9b6-4e64-a0ac-04d83b2c0714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:01.954599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:01.956117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:01.982104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 884/1766] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:01.983150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:01.990526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:02.017564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2b10c791-a9b6-4e64-a0ac-04d83b2c0714 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:02.021429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ce99-32c4-4452-b656-0559bd0c2b4e service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:02.023088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2b10c791-a9b6-4e64-a0ac-04d83b2c0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:02.042620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:02.043589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:02.043821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:02.044102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] PATH_INFO: `/v3/users/c91c87583a6c4b0db51595707364f512` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:02.046971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91c87583a6c4b0db51595707364f512)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:02.057568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:02.069614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 883/1767] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:18:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:02.072555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:02.075138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:02.077423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:02.117560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:02.151171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:02.159656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:02.232441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 884/1768] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:02.233442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:02.254872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91c87583a6c4b0db51595707364f512'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:02.291298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a05e-1279-40ba-a5e3-8d83e3d6b538 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:02.294050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91c87583a6c4b0db51595707364f512'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:02.335950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91c87583a6c4b0db51595707364f512'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:02.337667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91c87583a6c4b0db51595707364f512'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:02.339912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:02.341566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:02.341915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:02.342287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:02.345811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:02.346248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:02.347938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:02.355162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d6e2d884-74f0-4d02-8b60-e9beee813c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91c87583a6c4b0db51595707364f512'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:02.370699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 885/1769] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:01 2022] DELETE /identity/v3/users/c91c87583a6c4b0db51595707364f512 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:02.375484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:02.375951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:02.376708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:02.379542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 885/1770] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:02.380854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:02.391955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:02.417337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbf94c-5ee4-481c-a3af-76cbd9c880fc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:02.426502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:02.427830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:02.594983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:02.596397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:02.598003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:02.598435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:02.599994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:02.603351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:02.612001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 886/1771] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:02.666825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:02.668626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:02.690666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 886/1772] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:02 2022] POST /identity/v3/projects => generated 371 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:02.693074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:02.760874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:02.905042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351f98e-9520-4a57-87bf-b054f2f9a2c8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:02.921568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1109a2f-b027-4a39-adcc-0daf15c25bec None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:02.922733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:02.924858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:02.925155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:02.925935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:02.927388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:02.934903 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:03.002411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 887/1773] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:02 2022] POST /identity/v3/users => generated 286 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:03.009619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:03.040806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524b26-e0db-42cc-a995-7c91c2b2de25 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:03.067054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:03.068082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:03.068386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:03.068688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:03.070650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:03.073448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:03.076486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:03.088377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:03.089806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:03.092277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:03.092569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:03.101009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 888/1774] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:03.104815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:03.115671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:03.119668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:03.132699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2f69-65cc-44d6-96d0-6be02549c8f7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:03.145196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:03.146242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:03.147525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 887/1775] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:03.147819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:03.148107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:03.149775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:03.152327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:03.170834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 889/1776] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:03.172077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:03.185241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407354-0bb0-4d23-bfee-10e4e2a21579 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:03.200329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e997-b627-45a2-a659-42b8e8c718aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:03.201766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e997-b627-45a2-a659-42b8e8c718aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:03.202058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e997-b627-45a2-a659-42b8e8c718aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:03.202339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e997-b627-45a2-a659-42b8e8c718aa admin admin] PATH_INFO: `/v3/projects/f2b3f4586f574c5db015c6e6bc826529/users/d34308e611254e51b3d9eaeafcba5ea0/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:03.222153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:03.225162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:03.255998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732e997-b627-45a2-a659-42b8e8c718aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b3f4586f574c5db015c6e6bc826529, user_id=d34308e611254e51b3d9eaeafcba5ea0, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:03.258785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732e997-b627-45a2-a659-42b8e8c718aa admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:03.306450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 888/1777] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:03 2022] PUT /identity/v3/projects/f2b3f4586f574c5db015c6e6bc826529/users/d34308e611254e51b3d9eaeafcba5ea0/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:03.318003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:03.318360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:03.318567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:03.393852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] MFA Rules not processed for user `d34308e611254e51b3d9eaeafcba5ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:03.395145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:03.434769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3278b9-2989-424a-a129-fed351fe3e3c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:03.642851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:03.644551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:03.645505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:03.646353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:03.651248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:03.683996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:03.686228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:03.715673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 890/1778] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:03.717046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:03.723397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:03.730366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 889/1779] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:03.735102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:03.760176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:03.978978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf79020-bb09-4f79-bca7-28a1e69abe10 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:04.002416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:04.003602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:04.003722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:04.003972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] PATH_INFO: `/v3/users/d690647ea0e34d30a2bb30dd74b44779` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:04.006582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d690647ea0e34d30a2bb30dd74b44779)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:04.010979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:04.035348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee0f7b-49c4-4e33-a011-4bec0929383e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:04.047062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:04.047958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:04.061360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:04.062183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:04.062959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:04.066409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:04.156137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 890/1780] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:03 2022] POST /identity/v3/projects => generated 373 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:04.158538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:04.177126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd690647ea0e34d30a2bb30dd74b44779'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.177878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd690647ea0e34d30a2bb30dd74b44779'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.219606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd690647ea0e34d30a2bb30dd74b44779'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.282334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd690647ea0e34d30a2bb30dd74b44779'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.282968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd690647ea0e34d30a2bb30dd74b44779'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.335634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:04.367331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 891/1781] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:03 2022] DELETE /identity/v3/users/d690647ea0e34d30a2bb30dd74b44779 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:04.376593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:04.386852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:04.408550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613781a9-0629-41bc-8c52-2ce5241add21 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:04.600308 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad82a3-a81c-487f-bb1a-8f8f1bab1f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:04.601237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad82a3-a81c-487f-bb1a-8f8f1bab1f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:04.601382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad82a3-a81c-487f-bb1a-8f8f1bab1f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:04.601630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad82a3-a81c-487f-bb1a-8f8f1bab1f35 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:04.602345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad82a3-a81c-487f-bb1a-8f8f1bab1f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:04.604436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad82a3-a81c-487f-bb1a-8f8f1bab1f35 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:04.612277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ba1b-ab27-452e-a9f0-030a40a084d6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:04.630817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:04.634196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:04.634516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:04.636497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] PATH_INFO: `/v3/projects/409f36960f7347de8b4649a3b609c4a4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:04.639281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=409f36960f7347de8b4649a3b609c4a4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:04.643403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:04.661462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 891/1782] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:04 2022] POST /identity/v3/users => generated 293 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:04.662653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:04.662864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:04.663168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:04.733597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:04.734737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:04.758103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 892/1783] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:04.774323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:04.789411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:04.789653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:04.822958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457b10-e8cb-4eea-93d4-33ee59c28e50 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:04.825413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409f36960f7347de8b4649a3b609c4a4', 'request_id': 'req-59811be7-255d-4ecc-b488-705774a71a0b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.839721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409f36960f7347de8b4649a3b609c4a4', 'request_id': 'req-59811be7-255d-4ecc-b488-705774a71a0b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.873450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409f36960f7347de8b4649a3b609c4a4', 'request_id': 'req-59811be7-255d-4ecc-b488-705774a71a0b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.909671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] The token cache is being invalidate because project 409f36960f7347de8b4649a3b609c4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:04.909974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.919224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59811be7-255d-4ecc-b488-705774a71a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:04.924017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 892/1784] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:04 2022] DELETE /identity/v3/projects/409f36960f7347de8b4649a3b609c4a4 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:04.925609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a018b2-b38a-4823-b5a2-84761707f48a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:04.930395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a018b2-b38a-4823-b5a2-84761707f48a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:04.930762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a018b2-b38a-4823-b5a2-84761707f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:04.993276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-58a018b2-b38a-4823-b5a2-84761707f48a None None] MFA Rules not processed for user `8c5d1f4f0bec40ad8e325f8f92739b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:04.997846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-58a018b2-b38a-4823-b5a2-84761707f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.050851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:05.052074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.059111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.059381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.060473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:05.070434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:05.107899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 893/1785] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:05.107899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:05.126265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.244740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 893/1786] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:05.250350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c7a6f-7ae8-4f31-b3b3-530f2ba43480 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.250633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c7a6f-7ae8-4f31-b3b3-530f2ba43480 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.250911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c7a6f-7ae8-4f31-b3b3-530f2ba43480 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.252376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 894/1787] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 17:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:18:05.261649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c7a6f-7ae8-4f31-b3b3-530f2ba43480 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:05.267680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-318c7a6f-7ae8-4f31-b3b3-530f2ba43480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.298448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c7a6f-7ae8-4f31-b3b3-530f2ba43480 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:05.308500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:05.310213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.310991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.310991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] PATH_INFO: `/v3/users/91d131bbf6e24290956d7f383c010dbf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.313068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d131bbf6e24290956d7f383c010dbf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:05.316561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:05.339158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7574-3046-44d5-9f3e-1ffbc9baef39 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:05.344190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:05.345152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.345540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.345903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.348540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.369520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:05.371325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:05.404502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 894/1788] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:05.408091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:05.410922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.454890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d131bbf6e24290956d7f383c010dbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:05.456126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d131bbf6e24290956d7f383c010dbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:05.461722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc90d6-6cf0-43ee-b073-0ca08ddc0c55 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:05.481722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcb2ba-270a-43b4-bcb3-094e7a1fb635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:05.481722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb2ba-270a-43b4-bcb3-094e7a1fb635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.481722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb2ba-270a-43b4-bcb3-094e7a1fb635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.482303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb2ba-270a-43b4-bcb3-094e7a1fb635 admin admin] PATH_INFO: `/v3/projects/af97745cf158416bb69effcbac68359e/users/def4cb2460a743e3b018d3647d322c27/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.489557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:05.502580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d131bbf6e24290956d7f383c010dbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:05.520804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d131bbf6e24290956d7f383c010dbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:05.522049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a0cacdde-fedd-4c97-999c-06727926fb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d131bbf6e24290956d7f383c010dbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:05.548190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcb2ba-270a-43b4-bcb3-094e7a1fb635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af97745cf158416bb69effcbac68359e, user_id=def4cb2460a743e3b018d3647d322c27, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:05.558290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcb2ba-270a-43b4-bcb3-094e7a1fb635 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:05.560951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 895/1789] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:05 2022] DELETE /identity/v3/users/91d131bbf6e24290956d7f383c010dbf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:05.563434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.573306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.573834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.605968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 895/1790] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:05 2022] PUT /identity/v3/projects/af97745cf158416bb69effcbac68359e/users/def4cb2460a743e3b018d3647d322c27/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:05.611693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37953d59-a60f-4938-8562-e48811749beb None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:05.613474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37953d59-a60f-4938-8562-e48811749beb None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:05.627584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37953d59-a60f-4938-8562-e48811749beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:05.647730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] MFA Rules not processed for user `40c00c0bcb534a5a969bff4651cef40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:05.649366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.701567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-37953d59-a60f-4938-8562-e48811749beb None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:05.704313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-37953d59-a60f-4938-8562-e48811749beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.755530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:05.875914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 896/1791] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:05.875914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:05.875914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:05.928578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 896/1792] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:05.929736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37953d59-a60f-4938-8562-e48811749beb None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:05.932694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-37953d59-a60f-4938-8562-e48811749beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:06.067008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c80fc-10e2-4fc1-a2fd-23d4b9183194 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.089132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.089867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.090163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.090457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.091241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.095081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.120679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 897/1793] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:06.121918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.124138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:06.136141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37953d59-a60f-4938-8562-e48811749beb None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.151373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26257f-7960-4bec-9bef-3368ae93e973 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.157334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.158111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.158387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.158572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.158708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.159267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.159551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.159826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.160535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.162599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.172243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.174000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.196036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 898/1794] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:06.199957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.250558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad2755-84ec-4edf-b77b-f50d344473d2 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.265273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.265273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.265589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.265589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] PATH_INFO: `/v3/projects/af97745cf158416bb69effcbac68359e/users/def4cb2460a743e3b018d3647d322c27/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.268159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af97745cf158416bb69effcbac68359e, user_id=def4cb2460a743e3b018d3647d322c27, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.271037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.283184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 897/1795] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:05 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:06.287582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.293694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 899/1796] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:06 2022] PUT /identity/v3/projects/af97745cf158416bb69effcbac68359e/users/def4cb2460a743e3b018d3647d322c27/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:06.295734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.297669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:06.461564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81491bc-4bf3-4521-83d5-4b133bf61d86 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.466569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.468363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.468703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.468987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] PATH_INFO: `/v3/projects/3eec6abebcf24066a797847261b253f2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.470412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eec6abebcf24066a797847261b253f2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.472713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.482291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84431a26-5e18-489c-af4e-dde1ae527823 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.495998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99316a4-8d1d-4ea3-b9fb-96d1be516283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.498801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99316a4-8d1d-4ea3-b9fb-96d1be516283 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.499163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99316a4-8d1d-4ea3-b9fb-96d1be516283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.499456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99316a4-8d1d-4ea3-b9fb-96d1be516283 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.500186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99316a4-8d1d-4ea3-b9fb-96d1be516283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.507028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99316a4-8d1d-4ea3-b9fb-96d1be516283 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.544897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:06.563552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eec6abebcf24066a797847261b253f2', 'request_id': 'req-8e7628c0-5972-485b-bb55-521856eb294c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.570558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 898/1797] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:06 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:06.570558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.573152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.573408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.576570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eec6abebcf24066a797847261b253f2', 'request_id': 'req-8e7628c0-5972-485b-bb55-521856eb294c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.587685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eec6abebcf24066a797847261b253f2', 'request_id': 'req-8e7628c0-5972-485b-bb55-521856eb294c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.605495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] The token cache is being invalidate because project 3eec6abebcf24066a797847261b253f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:06.605795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.606634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.609280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 900/1798] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:06 2022] DELETE /identity/v3/projects/3eec6abebcf24066a797847261b253f2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:06.610210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.611902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:06.642402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:06.676421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] MFA Rules not processed for user `def4cb2460a743e3b018d3647d322c27`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:06.677711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:06.696777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7628c0-5972-485b-bb55-521856eb294c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.702942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.713846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.717123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.717768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.721116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.725965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.756499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 901/1799] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:06.757491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.764029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:06.780086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e1d4-7d1d-42d1-af21-9c6f44a6dcfd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.793194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.795555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.796941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.797266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] PATH_INFO: `/v3/users/70549157ce6342969918dd53f55de67b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.803133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70549157ce6342969918dd53f55de67b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:06.812714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:06.909340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 899/1800] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:06.911629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:06.941618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70549157ce6342969918dd53f55de67b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.944091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70549157ce6342969918dd53f55de67b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:06.951687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa26480-761b-4038-b3b6-f6c32bc75ad7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:06.968483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:06.969571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:06.969873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:06.970165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] PATH_INFO: `/v3/projects/eb9bb36d68bc425a8570070b71dcf304/users/1748a1baeabd42f8b465aacedb3f24c6/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:06.992542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70549157ce6342969918dd53f55de67b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:07.011453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70549157ce6342969918dd53f55de67b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:07.013232 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70549157ce6342969918dd53f55de67b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:07.025586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9bb36d68bc425a8570070b71dcf304, user_id=1748a1baeabd42f8b465aacedb3f24c6, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:07.028334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:07.041938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 902/1801] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:06 2022] DELETE /identity/v3/users/70549157ce6342969918dd53f55de67b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:07.042633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:07.044664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:07.059569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 900/1802] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:06 2022] PUT /identity/v3/projects/eb9bb36d68bc425a8570070b71dcf304/users/1748a1baeabd42f8b465aacedb3f24c6/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:07.065779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:07.070586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:07.111109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:07.155833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce293c-8da8-4e1f-822c-c3ff90facae4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:07.191175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0ca0-bbad-4d57-a7b2-9ba3533ba4ff admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:07.201269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:07.202024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:07.202425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:07.202700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:07.204080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:07.206493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:07.220156 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 901/1803] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:07.225227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:07.225937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:07.226975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:07.227411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:07.227963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:07.230134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:07.245815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3eb0f-f385-4d59-94d5-e3429439fe35 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:07.254950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:07.256637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:07.257015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:07.257409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] PATH_INFO: `/v3/projects/eb9bb36d68bc425a8570070b71dcf304/users/1748a1baeabd42f8b465aacedb3f24c6/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:07.260564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9bb36d68bc425a8570070b71dcf304, user_id=1748a1baeabd42f8b465aacedb3f24c6, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:07.265691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:07.283489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 902/1804] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:07 2022] PUT /identity/v3/projects/eb9bb36d68bc425a8570070b71dcf304/users/1748a1baeabd42f8b465aacedb3f24c6/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:07.432537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:07.434090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:07.469026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 903/1805] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:07.507605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:07.509615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:07.686175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:07.707441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:07.726516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101a02a-dca0-44e9-a359-4b241435a841 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:07.729830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbea4d4-3632-4cdd-9cb8-f32883a82a7b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:07.741044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:07.742433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:07.744330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:07.744637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] PATH_INFO: `/v3/projects/51cd4aa340524feeb02a400b403204e2` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:07.746132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cd4aa340524feeb02a400b403204e2)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:07.750743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:07.909940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:07.910753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:07.911351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:07.919092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:07.921866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:07.987265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cd4aa340524feeb02a400b403204e2', 'request_id': 'req-dd8abe3c-e870-48be-ba55-70573bd07afd'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.006077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cd4aa340524feeb02a400b403204e2', 'request_id': 'req-dd8abe3c-e870-48be-ba55-70573bd07afd'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.018957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cd4aa340524feeb02a400b403204e2', 'request_id': 'req-dd8abe3c-e870-48be-ba55-70573bd07afd'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.047300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] The token cache is being invalidate because project 51cd4aa340524feeb02a400b403204e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:08.048742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.050085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd8abe3c-e870-48be-ba55-70573bd07afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.055676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 903/1806] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:07 2022] DELETE /identity/v3/projects/51cd4aa340524feeb02a400b403204e2 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:08.060385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3342f2-613b-4a59-90ec-e2471a4c76d0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.061773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3342f2-613b-4a59-90ec-e2471a4c76d0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.062204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3342f2-613b-4a59-90ec-e2471a4c76d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.076578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:08.088015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:08.095825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:08.129607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-4b3342f2-613b-4a59-90ec-e2471a4c76d0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:08.130860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4b3342f2-613b-4a59-90ec-e2471a4c76d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.158659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 904/1807] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:08.161410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:08.169203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.208186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17610-7e8f-4699-a450-6ef0f54cbb4d service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:08.313221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 904/1808] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:08.320831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.321335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.321782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.404727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:08.405531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.406607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.407304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] PATH_INFO: `/v3/projects/4a5ff0c81d9c4eb69dccc17f0f7dc367` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.411000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5ff0c81d9c4eb69dccc17f0f7dc367)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:08.414657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:08.422304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:08.427302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.456684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 905/1809] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:08.458231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:08.463601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.496458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07036797-948f-47f8-9c28-4ec1ed5c9a4c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:08.516382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:08.519820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.521842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.522150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] PATH_INFO: `/v3/users/5d786c2bc1a546cb88524bf03a49938c` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.526374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d786c2bc1a546cb88524bf03a49938c)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:08.529513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:08.542039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5ff0c81d9c4eb69dccc17f0f7dc367', 'request_id': 'req-88f49a21-af6b-4ca0-9b9e-63617ef24130'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.551133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5ff0c81d9c4eb69dccc17f0f7dc367', 'request_id': 'req-88f49a21-af6b-4ca0-9b9e-63617ef24130'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.582073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5ff0c81d9c4eb69dccc17f0f7dc367', 'request_id': 'req-88f49a21-af6b-4ca0-9b9e-63617ef24130'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.613144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] The token cache is being invalidate because project 4a5ff0c81d9c4eb69dccc17f0f7dc367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:08.614016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.616510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.624197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 905/1810] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:08 2022] DELETE /identity/v3/projects/4a5ff0c81d9c4eb69dccc17f0f7dc367 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:08.627254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:08.629793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.662118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d786c2bc1a546cb88524bf03a49938c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.678473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d786c2bc1a546cb88524bf03a49938c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.704402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:08.708009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d786c2bc1a546cb88524bf03a49938c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.709651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d786c2bc1a546cb88524bf03a49938c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.728724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-812eae55-6649-473f-9b72-47c09c098f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d786c2bc1a546cb88524bf03a49938c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:08.760514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 906/1811] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:08 2022] DELETE /identity/v3/users/5d786c2bc1a546cb88524bf03a49938c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:08.761978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e62ee5-72a6-44b6-b2ef-3a2c5c5ae872 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.762272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e62ee5-72a6-44b6-b2ef-3a2c5c5ae872 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.768289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e62ee5-72a6-44b6-b2ef-3a2c5c5ae872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.806609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a6e62ee5-72a6-44b6-b2ef-3a2c5c5ae872 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:08.808131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a6e62ee5-72a6-44b6-b2ef-3a2c5c5ae872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.815096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f49a21-af6b-4ca0-9b9e-63617ef24130 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:08.868011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:08.909625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 907/1812] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:08.911607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.912082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.912439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.918474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:08.919892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.920258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.920536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.921776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:08.922267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:08.924554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfc67e-768c-476d-ae97-d83147cca4ba admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:08.953240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:08.964847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 906/1813] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:08.964847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b4e0-c257-40df-b74d-76f191125343 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:08.964847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b4e0-c257-40df-b74d-76f191125343 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:08.964847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b4e0-c257-40df-b74d-76f191125343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:08.965192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.978608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 908/1814] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:08.981233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:08.984551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:08.992460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c403b4e0-c257-40df-b74d-76f191125343 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:08.995290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c403b4e0-c257-40df-b74d-76f191125343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:09.016833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 907/1815] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:09.018735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.019190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.019687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ed42-c9a0-4004-b4d9-4f0a9efd0383 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.019840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.030684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.032202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.032501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.032809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.033594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.035580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.067767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] MFA Rules not processed for user `1748a1baeabd42f8b465aacedb3f24c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:09.069364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:09.120809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 909/1816] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:08 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:09.123021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.125168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:09.229752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f979-d17f-4617-91e5-fbe87eba69e5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.248329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.249124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.249418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.249704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.253994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 908/1817] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:09.261358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.301003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01723774-af23-4e18-9448-2c20bfe4c303 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.404105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.405986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.425824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 910/1818] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:09.426828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.438326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.439158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.440115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.440115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.440716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:09.441039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.443152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.443290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd38c-46ed-4fc1-b474-a787ac69ac76 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.467736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.468460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.468771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.469048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.469750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.479649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.481345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 909/1819] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:09.482363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.490820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:09.524973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:09.553252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 911/1820] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:09 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:09.553252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.572775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8233585-750c-4471-b1cd-030540937b49 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.581136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.588737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.590062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.591488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.594310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.598457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.618420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:09.655842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 912/1821] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:09 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:09.657103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.658841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814db01-aa64-4747-995b-8748a01e468c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.729943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.730632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.730921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.732322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.734402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:09.784064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c70e5d-0205-495e-a090-2cfb47a79d1a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.789381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.790350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.790721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.790823 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.791582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.795001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.815707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 913/1822] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:09.816575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.827167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382e89-c91f-4066-accf-7016059c16ba admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.838114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.838819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.839104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.839632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.840233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.846712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.888725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.889488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 914/1823] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:09 2022] POST /identity/v3/users => generated 304 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:09.889936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.894891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.913196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299db7b-e8a3-41e8-9199-d3149a65b0ec admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.922087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 910/1824] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:09.923115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.925356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.926073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.926380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.926639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.927393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.929082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.960630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7cd54-7516-4520-9672-c83b4baeffcb service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:09.970607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 915/1825] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:09.972456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:09.974662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:09.976247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:09.976404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:09.978447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:09.979386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:09.982445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:09.995314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8b0a-fa68-4cc6-8cfd-3cd420c5dfda admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:10.010410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 911/1826] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:10.010944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:10.013209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3ab7c-4b61-480c-8bb1-3c4cf0201ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:10.014920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3ab7c-4b61-480c-8bb1-3c4cf0201ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.014920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3ab7c-4b61-480c-8bb1-3c4cf0201ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.015283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3ab7c-4b61-480c-8bb1-3c4cf0201ed2 admin admin] PATH_INFO: `/v3/projects/3f9489f62f03498ca521bbbe4efcaf1b/users/bb94761d5bad4ce8ae7efa82fbc5d5fb/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.038382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c5f2-9a3d-43fd-a5fd-30a410f9055d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:10.049662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:10.051671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.051919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.052145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.053072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3ab7c-4b61-480c-8bb1-3c4cf0201ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9489f62f03498ca521bbbe4efcaf1b, user_id=bb94761d5bad4ce8ae7efa82fbc5d5fb, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:10.055164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:10.057543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:10.059229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3ab7c-4b61-480c-8bb1-3c4cf0201ed2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:10.083912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 912/1827] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:10.087258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:10.104831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 916/1828] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:09 2022] PUT /identity/v3/projects/3f9489f62f03498ca521bbbe4efcaf1b/users/bb94761d5bad4ce8ae7efa82fbc5d5fb/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:10.106575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.106927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.107257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.129141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079eb5e5-b61a-4629-b813-7c4353f4b5a0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:10.198093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] MFA Rules not processed for user `bb94761d5bad4ce8ae7efa82fbc5d5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:10.198810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:10.286898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 917/1829] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:10.293749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:10.316653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:10.361456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afbb78-7cd5-4bcd-961b-77cd33236b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:10.363550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afbb78-7cd5-4bcd-961b-77cd33236b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.363852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afbb78-7cd5-4bcd-961b-77cd33236b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.364142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afbb78-7cd5-4bcd-961b-77cd33236b26 admin admin] PATH_INFO: `/v3/projects/945fc204602f45c89789722b9cd86a61/users/6d8bea66b0744f86bb35953d277502fc/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.399404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afbb78-7cd5-4bcd-961b-77cd33236b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945fc204602f45c89789722b9cd86a61, user_id=6d8bea66b0744f86bb35953d277502fc, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:10.411778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afbb78-7cd5-4bcd-961b-77cd33236b26 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:10.433629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 913/1830] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:10 2022] PUT /identity/v3/projects/945fc204602f45c89789722b9cd86a61/users/6d8bea66b0744f86bb35953d277502fc/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:10.445988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.448329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.448748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.518628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00751e-96d1-4a4a-82ca-29adb1fbc4b2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:10.521924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:10.552872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] MFA Rules not processed for user `6d8bea66b0744f86bb35953d277502fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:10.554233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:10.704449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:10.706346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.707598 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.708854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.711612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:10.714223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:10.720779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 914/1831] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:10.722058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:10.726570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:10.753708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 918/1832] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:10 2022] POST /identity/v3/projects => generated 379 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:10.754882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:10.760474 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a453-4e74-4b88-96e9-9a7caad8c1a2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:10.844145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e0b2-9067-4c17-a7fe-12aac7b90bc7 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:10.852503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:10.853943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.854240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.854791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.855875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:10.859495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:10.902356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 919/1833] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:10 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:10.902356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:10.915969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:10.918938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:10.919449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:10.919831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] PATH_INFO: `/v3/projects/95f843d7f5e34140b3a56366f170528f` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:10.921389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f843d7f5e34140b3a56366f170528f)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:10.925021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:10.938327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:11.013874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255a4d7-6905-44d2-9c16-6f97a3548763 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.020544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f843d7f5e34140b3a56366f170528f', 'request_id': 'req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:11.031862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f843d7f5e34140b3a56366f170528f', 'request_id': 'req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:11.049102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f843d7f5e34140b3a56366f170528f', 'request_id': 'req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:11.078195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] The token cache is being invalidate because project 95f843d7f5e34140b3a56366f170528f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:11.078941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:11.080017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:11.082637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 915/1834] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:10 2022] DELETE /identity/v3/projects/95f843d7f5e34140b3a56366f170528f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:11.083872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.086149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:11.125901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550cbb-e037-456e-b2ba-fee3e883d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.126653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550cbb-e037-456e-b2ba-fee3e883d7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.126938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550cbb-e037-456e-b2ba-fee3e883d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.127223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550cbb-e037-456e-b2ba-fee3e883d7dc admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.127920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52550cbb-e037-456e-b2ba-fee3e883d7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.129926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52550cbb-e037-456e-b2ba-fee3e883d7dc admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.136948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:11.164765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 920/1835] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:10 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:11.166238 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.166512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.166877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.190481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:11.192154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:11.192921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5dbc5-4f4b-4773-95b1-9f12dea763f6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.204013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c19b08-f158-4df7-a084-58bf39651cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.204989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c19b08-f158-4df7-a084-58bf39651cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.205972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c19b08-f158-4df7-a084-58bf39651cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.206365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c19b08-f158-4df7-a084-58bf39651cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.207269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c19b08-f158-4df7-a084-58bf39651cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.210007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c19b08-f158-4df7-a084-58bf39651cf1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.214499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 921/1836] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:11.215660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.217381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:11.230077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37e952-023e-46a0-8602-d29330fe8691 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.236330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.237081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.237361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.237670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.240034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.241713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.249995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 916/1837] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:11 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:11.252524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.253064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.253587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.280401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 922/1838] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:11.281551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.309244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:11.311457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:11.322891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee39451-d5df-401e-ba20-ee408e485096 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.324860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 917/1839] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:11.326351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.344134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.345757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.346067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.346331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.347095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.348800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.349533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfba62-5e12-457d-884a-107778cd2c3c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.356391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.357331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.357718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.358092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.359414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.361769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.377902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 918/1840] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:11.378092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 923/1841] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:11.378092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.380736 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.398863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a09de8-69c6-4027-b40f-cf7051dae940 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.402656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766c11-51b8-416e-bc61-e32ee485bf50 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.405046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.406008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.406492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.406964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.407900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:11.408409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.410587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.412142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23203-45df-4a2d-b436-05c24ce9dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.413445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23203-45df-4a2d-b436-05c24ce9dd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.413727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23203-45df-4a2d-b436-05c24ce9dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.415719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23203-45df-4a2d-b436-05c24ce9dd56 admin admin] PATH_INFO: `/v3/projects/a0e3c47793ef4c338865860e870ec592/users/6866001cb8a74214b7241ede7f2d3060/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.427740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 919/1842] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:11.428951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.448995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa2ed-c99c-4a8d-a819-c937022fb234 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.454187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada23203-45df-4a2d-b436-05c24ce9dd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e3c47793ef4c338865860e870ec592, user_id=6866001cb8a74214b7241ede7f2d3060, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.461771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada23203-45df-4a2d-b436-05c24ce9dd56 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.467028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.468077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.468572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.470303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] PATH_INFO: `/v3/projects/50da1af14ab44b8292d4bc11a0b8979d/users/2e6e5bce51d7496784bd6e4f74714e31/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.510072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50da1af14ab44b8292d4bc11a0b8979d, user_id=2e6e5bce51d7496784bd6e4f74714e31, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.510685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 924/1843] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:11 2022] PUT /identity/v3/projects/a0e3c47793ef4c338865860e870ec592/users/6866001cb8a74214b7241ede7f2d3060/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:11.526530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12a9d-207c-4a49-b863-ab4cc6c93a5b None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.527014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12a9d-207c-4a49-b863-ab4cc6c93a5b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.527625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12a9d-207c-4a49-b863-ab4cc6c93a5b None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.529861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.533095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 925/1844] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:18:11 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:18:11.533095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b12a9d-207c-4a49-b863-ab4cc6c93a5b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.578517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 920/1845] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:11 2022] PUT /identity/v3/projects/50da1af14ab44b8292d4bc11a0b8979d/users/2e6e5bce51d7496784bd6e4f74714e31/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:11.579512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:11.667335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b12a9d-207c-4a49-b863-ab4cc6c93a5b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.683962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:11.726806 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2f334-c09f-4ef6-83a2-d99b6bb5163c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:11.738422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dae8a-0207-4ccd-81a5-4925d6a10ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.739137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dae8a-0207-4ccd-81a5-4925d6a10ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.739432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dae8a-0207-4ccd-81a5-4925d6a10ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.739709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dae8a-0207-4ccd-81a5-4925d6a10ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.740468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dae8a-0207-4ccd-81a5-4925d6a10ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.742175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dae8a-0207-4ccd-81a5-4925d6a10ec9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.768125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 921/1846] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:11.769715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1ae4-4959-4d31-a70d-24f0f6cdf43b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.770019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1ae4-4959-4d31-a70d-24f0f6cdf43b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.770324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1ae4-4959-4d31-a70d-24f0f6cdf43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.827424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:11.828320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:11.828763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:11.829143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:11.829942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:11.838875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:11.873894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d92a1ae4-4959-4d31-a70d-24f0f6cdf43b None None] MFA Rules not processed for user `2e6e5bce51d7496784bd6e4f74714e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:11.875204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d92a1ae4-4959-4d31-a70d-24f0f6cdf43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:11.906332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 926/1847] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:11 2022] POST /identity/v3/projects => generated 405 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:11.906332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.084536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:12.098932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59339-b143-4dc9-a396-4e0af4bfc53f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.115780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.116932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.118888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.120325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] PATH_INFO: `/v3/projects/a0e3c47793ef4c338865860e870ec592/users/6866001cb8a74214b7241ede7f2d3060/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.126853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e3c47793ef4c338865860e870ec592, user_id=6866001cb8a74214b7241ede7f2d3060, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.133185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.157643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 922/1848] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:12.157643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.157915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.160308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.161492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 927/1849] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:11 2022] PUT /identity/v3/projects/a0e3c47793ef4c338865860e870ec592/users/6866001cb8a74214b7241ede7f2d3060/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:12.163455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.210436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:12.212098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:12.315164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3f2bc-2426-4a37-bc7c-0a81fb78bf3b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.324545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.326097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.327373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.329672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.330541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.334304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 923/1850] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:12.334452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.337821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.339837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:12.377800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 928/1851] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:12 2022] POST /identity/v3/users => generated 303 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:12.378584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.393180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173aa0eb-0f7f-4b45-95eb-ebc4d9b7af0a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.409217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df733913-6876-46d7-aad3-27dd30db09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.410166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733913-6876-46d7-aad3-27dd30db09f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.410618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733913-6876-46d7-aad3-27dd30db09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.411049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733913-6876-46d7-aad3-27dd30db09f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.411764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df733913-6876-46d7-aad3-27dd30db09f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.414057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df733913-6876-46d7-aad3-27dd30db09f5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.428225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d29d6e-961a-455a-a278-a7a1970a943b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.436377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.437221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.437730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.438881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.443926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:12.453584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:12.466994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 929/1852] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:12 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:12.468750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.469123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.469775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.513787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] MFA Rules not processed for user `6866001cb8a74214b7241ede7f2d3060`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:12.515904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:12.562340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.563722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.587087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 924/1853] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:12.587087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.587087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:12.614319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72568-caad-4403-b8e5-eb286ebfe618 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.648354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 930/1854] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:12.648354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.675080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:12.754288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f6f5b-1564-455e-bac6-ed48a1277b9f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.760306 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.761607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.762032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.762363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.763213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.765518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.769261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.769953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.770243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.770526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.779779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 931/1855] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:12.784297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.796874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.798535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.800934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3340aa-ac93-4ece-84a8-fbda1b551cdd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.810669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.811610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.812711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.813197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.814100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.816260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.836430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 925/1856] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:12.837228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.839506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:12.844426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 932/1857] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:12 2022] POST /identity/v3/users => generated 295 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:12.845282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.858579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb6ee-ee7d-48ef-8f62-3538b5ee51de admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.865283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.866417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.866774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.867513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.868882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.871216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.900736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 933/1858] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:12.900736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.918305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d9edd-75d9-43bc-94ad-04fe02109aef admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.931708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.933248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.933606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.933955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:12.935279 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:12.938139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:12.961573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 934/1859] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:12.962938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:12.983349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a3d3d-adae-4a81-8490-d1a0f7cefe59 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:12.989522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a765-7139-478d-b510-0e496296a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:12.990791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a765-7139-478d-b510-0e496296a38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:12.990906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a765-7139-478d-b510-0e496296a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:12.991088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a765-7139-478d-b510-0e496296a38a admin admin] PATH_INFO: `/v3/projects/408ccbc4b02947189a4e0e95051d6caf/users/031d947d18394fa9be63f7e9d75a8d30/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.005033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9ec0-d219-486b-b1d6-ff02b3e88496 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.014497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.015411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.015702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.017447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.025482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a765-7139-478d-b510-0e496296a38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=408ccbc4b02947189a4e0e95051d6caf, user_id=031d947d18394fa9be63f7e9d75a8d30, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.032743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.034239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.035663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a765-7139-478d-b510-0e496296a38a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.058795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 926/1860] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:13.062202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.072993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 935/1861] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:12 2022] PUT /identity/v3/projects/408ccbc4b02947189a4e0e95051d6caf/users/031d947d18394fa9be63f7e9d75a8d30/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:13.074947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.075250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.075657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.094219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858481a-3b3f-4768-9199-e9c6480db2cc service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.113607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:13.115333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:13.162378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:13.239064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.240385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.240672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.240962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] PATH_INFO: `/v3/projects/89d171d8e25e4e51b0a2f1609aaaf99a/users/9cd65633d1dc4fd48ae93eb5e7f56666/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.252650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 936/1862] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:13.266846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.271971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d171d8e25e4e51b0a2f1609aaaf99a, user_id=9cd65633d1dc4fd48ae93eb5e7f56666, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.272349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:13.274804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.304185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 927/1863] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:13 2022] PUT /identity/v3/projects/89d171d8e25e4e51b0a2f1609aaaf99a/users/9cd65633d1dc4fd48ae93eb5e7f56666/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:13.306269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.363262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296cc3c-4e91-40b0-881c-bacd363e42b7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.367688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:13.395492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0042b2-c875-4102-a3fb-7b3f0727dde8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.405841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.406536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.406828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.407111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.407848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.409524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.425098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 928/1864] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:13.425098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.432372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.433557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.434215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.434587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.446022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.447589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.463319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 937/1865] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:13.473969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.493511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776d14-9b72-4c91-85c2-2654613bbe10 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.500968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b389a2e-4305-4942-b683-04489f53eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.502028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b389a2e-4305-4942-b683-04489f53eee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.502377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b389a2e-4305-4942-b683-04489f53eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.502718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b389a2e-4305-4942-b683-04489f53eee7 admin admin] PATH_INFO: `/v3/projects/89d171d8e25e4e51b0a2f1609aaaf99a/users/9cd65633d1dc4fd48ae93eb5e7f56666/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.504830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b389a2e-4305-4942-b683-04489f53eee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d171d8e25e4e51b0a2f1609aaaf99a, user_id=9cd65633d1dc4fd48ae93eb5e7f56666, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.508381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b389a2e-4305-4942-b683-04489f53eee7 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.512102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845eeed-a625-4fbb-9ddf-178c24ac8c48 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.516638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.517385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.517675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.517957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.520769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:13.521601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 938/1866] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:13 2022] PUT /identity/v3/projects/89d171d8e25e4e51b0a2f1609aaaf99a/users/9cd65633d1dc4fd48ae93eb5e7f56666/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:13.535424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.541000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.542165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.583046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] MFA Rules not processed for user `9cd65633d1dc4fd48ae93eb5e7f56666`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:13.584350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:13.593986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.595794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.608434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 929/1867] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:13.667622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:13.706746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 939/1868] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:13.719053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.728420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66063c72-2e34-4a27-80a9-0961c6935510 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.810783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1dc5-aea1-45d9-ba4a-b6c7559e7972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.813785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1dc5-aea1-45d9-ba4a-b6c7559e7972 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.814348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1dc5-aea1-45d9-ba4a-b6c7559e7972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.814923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1dc5-aea1-45d9-ba4a-b6c7559e7972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.834199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a1dc5-aea1-45d9-ba4a-b6c7559e7972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:13.836435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a1dc5-aea1-45d9-ba4a-b6c7559e7972 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:13.861724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 930/1869] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:13.935986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:13.950311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6ebb4-40ae-4e96-a05f-a5cea91d2bba None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:13.955784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:13.956785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:13.957251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:13.957793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:13.960873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:14.059361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.059361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.069519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 940/1870] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:14.241195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.241713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.241786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.274831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] MFA Rules not processed for user `031d947d18394fa9be63f7e9d75a8d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:14.276110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:14.316491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:14.408892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 931/1871] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:14.413604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.512937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7cd81-8003-4619-af4b-fd89d3bcbc15 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.518320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.519119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.519476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.519765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.521006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.522435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.549969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 941/1872] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:14.554212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.565214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7beb2-e67d-4d8c-9e31-f38c3531c7aa None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.620124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.620901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.621194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.621492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.622270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.624255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.649617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 932/1873] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:14 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:14.650926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.661690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339b5b7-4a2b-44f1-9f57-eb98b16056f0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.666627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.667320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.667604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.667885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.668640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.670349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.681851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 942/1874] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:14.686187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.696368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8b525-24bc-4f48-b086-f7ea5d445c7a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.701436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.702354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.703090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.703090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] PATH_INFO: `/v3/projects/87058ce7716c4f54bbe35c40aee53613/users/03894bf2f383423c874f741f02ff6803/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.720095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87058ce7716c4f54bbe35c40aee53613, user_id=03894bf2f383423c874f741f02ff6803, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.722888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.737149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 933/1875] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:14 2022] PUT /identity/v3/projects/87058ce7716c4f54bbe35c40aee53613/users/03894bf2f383423c874f741f02ff6803/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:14.741304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.751259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e489f6-2a69-4f63-98a5-88b7dfcb524c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.813665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0188-d4f6-4f43-9b0c-4cfe2cd22799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.814393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0188-d4f6-4f43-9b0c-4cfe2cd22799 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.814715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0188-d4f6-4f43-9b0c-4cfe2cd22799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.814997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0188-d4f6-4f43-9b0c-4cfe2cd22799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.815819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0188-d4f6-4f43-9b0c-4cfe2cd22799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.818039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0188-d4f6-4f43-9b0c-4cfe2cd22799 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.821820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:14.832773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 943/1876] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:14.836856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:14.848049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098c59-a2a1-4ab4-9c82-7bf52a31e698 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:14.858429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45994df-af66-4c6d-a6d4-9d6c715b6639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:14.862026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45994df-af66-4c6d-a6d4-9d6c715b6639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:14.862707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45994df-af66-4c6d-a6d4-9d6c715b6639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:14.863198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45994df-af66-4c6d-a6d4-9d6c715b6639 admin admin] PATH_INFO: `/v3/projects/87058ce7716c4f54bbe35c40aee53613/users/03894bf2f383423c874f741f02ff6803/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:14.865971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45994df-af66-4c6d-a6d4-9d6c715b6639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87058ce7716c4f54bbe35c40aee53613, user_id=03894bf2f383423c874f741f02ff6803, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:14.869276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45994df-af66-4c6d-a6d4-9d6c715b6639 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:14.884967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 934/1877] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:14 2022] PUT /identity/v3/projects/87058ce7716c4f54bbe35c40aee53613/users/03894bf2f383423c874f741f02ff6803/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:16.341411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ef4a4-6211-4e22-bd87-2be722982854 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:16.341955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ef4a4-6211-4e22-bd87-2be722982854 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:16.341955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ef4a4-6211-4e22-bd87-2be722982854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:16.383133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e60ef4a4-6211-4e22-bd87-2be722982854 None None] MFA Rules not processed for user `03894bf2f383423c874f741f02ff6803`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:16.394469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e60ef4a4-6211-4e22-bd87-2be722982854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:16.530523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 944/1878] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:17.086272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96b98-c953-4be0-a0ac-4cd5b390273d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:17.086840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96b98-c953-4be0-a0ac-4cd5b390273d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:17.086943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96b98-c953-4be0-a0ac-4cd5b390273d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:17.088422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 935/1879] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:18:17.101225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:17.101548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:17.101827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:17.127746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:17.129085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:17.242070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 945/1880] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:18:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:17.257790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96b98-c953-4be0-a0ac-4cd5b390273d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:17.259878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d5c96b98-c953-4be0-a0ac-4cd5b390273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:17.286648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96b98-c953-4be0-a0ac-4cd5b390273d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:17.292299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:17.293659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:17.294329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:17.295081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:17.309308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:17.309308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:17.320648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 936/1881] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:17.754278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:17.816651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf97e-6a1c-42ed-9e2b-e147dcf07c54 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:17.821650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:17.822536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:17.822821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:17.823094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] PATH_INFO: `/v3/users/031d947d18394fa9be63f7e9d75a8d30` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:17.824334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031d947d18394fa9be63f7e9d75a8d30)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:17.826334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:17.848947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:17.877603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031d947d18394fa9be63f7e9d75a8d30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:17.884251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031d947d18394fa9be63f7e9d75a8d30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:17.898332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031d947d18394fa9be63f7e9d75a8d30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:17.899102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031d947d18394fa9be63f7e9d75a8d30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:17.909482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031d947d18394fa9be63f7e9d75a8d30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:17.915722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 946/1882] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:17 2022] DELETE /identity/v3/users/031d947d18394fa9be63f7e9d75a8d30 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:18.115408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:18.127147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be264a3-2e99-46b1-8d83-78f38387580c service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:18.193797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:18.194623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:18.194912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:18.195192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] PATH_INFO: `/v3/projects/408ccbc4b02947189a4e0e95051d6caf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:18.196547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408ccbc4b02947189a4e0e95051d6caf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:18.198546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:18.207607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:18.258610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408ccbc4b02947189a4e0e95051d6caf', 'request_id': 'req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.267898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408ccbc4b02947189a4e0e95051d6caf', 'request_id': 'req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.277127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408ccbc4b02947189a4e0e95051d6caf', 'request_id': 'req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.290851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] The token cache is being invalidate because project 408ccbc4b02947189a4e0e95051d6caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:18.291236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.292126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b7ce20-9e21-4d31-bcc2-aef7fce8b7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.294334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 937/1883] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:18 2022] DELETE /identity/v3/projects/408ccbc4b02947189a4e0e95051d6caf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:18.298575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:18.300125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:18.317092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d56c7-f342-4309-90ca-dca2f6645324 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:18.420171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:18.421155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:18.421451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:18.421733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] PATH_INFO: `/v3/users/03894bf2f383423c874f741f02ff6803` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:18.422997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03894bf2f383423c874f741f02ff6803)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:18.425006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:18.496984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14cdf9-fb39-4e30-aea4-4e69edda2228 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:18.497271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14cdf9-fb39-4e30-aea4-4e69edda2228 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:18.497577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14cdf9-fb39-4e30-aea4-4e69edda2228 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:18.501774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 938/1884] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:18:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:18:18.522290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:18.522791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:18.523081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:18.551642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03894bf2f383423c874f741f02ff6803'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.563707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:18.569991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:18.578948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03894bf2f383423c874f741f02ff6803'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.615508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03894bf2f383423c874f741f02ff6803'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.616710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03894bf2f383423c874f741f02ff6803'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.634245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03894bf2f383423c874f741f02ff6803'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:18.645658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 947/1885] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:18 2022] DELETE /identity/v3/users/03894bf2f383423c874f741f02ff6803 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:18.676769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 939/1886] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:18:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:18.910190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:18.911621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:18.941282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:19.019014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e0f8-0855-445a-beee-3ed7b0699e87 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.025702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.026363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.026657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.027527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.037482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.039402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.051564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 948/1887] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:19.304438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.305947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:19.319368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d122f6-a61a-4f5d-9c42-66d373c2878e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.386207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.387890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.388768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.389314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] PATH_INFO: `/v3/projects/87058ce7716c4f54bbe35c40aee53613` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.390760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87058ce7716c4f54bbe35c40aee53613)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.392976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.454241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:19.483879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87058ce7716c4f54bbe35c40aee53613', 'request_id': 'req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.497131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87058ce7716c4f54bbe35c40aee53613', 'request_id': 'req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.517795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87058ce7716c4f54bbe35c40aee53613', 'request_id': 'req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.537503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] The token cache is being invalidate because project 87058ce7716c4f54bbe35c40aee53613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:19.539245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.554800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc6c15a5-9488-4d08-9c9f-f13a50d309c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.559117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 940/1888] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:19 2022] DELETE /identity/v3/projects/87058ce7716c4f54bbe35c40aee53613 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:19.564555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.566034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:19.570475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce6d9-56be-4b91-93f5-56d4e0e5df0f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.570769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce6d9-56be-4b91-93f5-56d4e0e5df0f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.571050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce6d9-56be-4b91-93f5-56d4e0e5df0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.590725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8ecbd-353e-4b77-9276-6978d388bcbe service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.613987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b21ce6d9-56be-4b91-93f5-56d4e0e5df0f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:19.615646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b21ce6d9-56be-4b91-93f5-56d4e0e5df0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:19.719003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.721882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.722605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.723658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] PATH_INFO: `/v3/users/bb94761d5bad4ce8ae7efa82fbc5d5fb` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.730835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb94761d5bad4ce8ae7efa82fbc5d5fb)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.733585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.766415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 941/1889] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:19.774439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.774744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.775034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.824820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:19.827519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:19.846455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 942/1890] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:19.850434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.863860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903cbf3-2342-4d51-9d62-c36027867cf3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:19.870485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb94761d5bad4ce8ae7efa82fbc5d5fb'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.879052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb94761d5bad4ce8ae7efa82fbc5d5fb'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.882665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:19.885402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.885696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.887389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.889652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:19.889965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:19.892577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:19.928915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb94761d5bad4ce8ae7efa82fbc5d5fb'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.929784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb94761d5bad4ce8ae7efa82fbc5d5fb'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.947795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 943/1891] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:18:19.952705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:19.954021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a89478c4-b208-4ffb-a972-c8c53970ce2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb94761d5bad4ce8ae7efa82fbc5d5fb'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:19.963322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 949/1892] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:19 2022] DELETE /identity/v3/users/bb94761d5bad4ce8ae7efa82fbc5d5fb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:19.967789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:19.968166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:19.968457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:19.974608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e0a3-2a92-48e1-9558-3a32c530596e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.012912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:20.014775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:20.087733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:20.113351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.116449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.118857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.119362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.120286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.127347 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.191661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 944/1893] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:20.195955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 950/1894] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:20.197038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.202584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:20.207791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.209705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:20.224389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb6223-914b-42fe-aa2b-1b0cc1382e17 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.277917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:20.336309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a26409-82c9-4534-a99e-1ab37d3b5f05 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.347235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.347994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.348231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.348508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.376440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.376440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.376440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.376440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.377042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.379072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.429397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 951/1895] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:20 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:20.431475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.444812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac669f7-d3b6-4c59-93c6-3e588ccdee44 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.449584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.450272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.450562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.450883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.451607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.454185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.460099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.461358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.471103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 952/1896] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:20.474664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.481029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 945/1897] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:20.487492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b607e-317b-4389-a507-84f2e6ab4507 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.503532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56139310-a323-4388-8d23-c58a4b46ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.504441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56139310-a323-4388-8d23-c58a4b46ed29 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.505563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56139310-a323-4388-8d23-c58a4b46ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.506128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56139310-a323-4388-8d23-c58a4b46ed29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.509155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56139310-a323-4388-8d23-c58a4b46ed29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.512043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56139310-a323-4388-8d23-c58a4b46ed29 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.541284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 953/1898] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:20.546358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.559502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96f9b-4a2f-4c39-a280-908b411e68ca service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.568753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.570145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.571118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.571423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] PATH_INFO: `/v3/projects/26063d9a1c1b497eb4a7be1ddcc53eb5/users/0aa2e932ffdd443c9b12e13d431c6c5a/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.592014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26063d9a1c1b497eb4a7be1ddcc53eb5, user_id=0aa2e932ffdd443c9b12e13d431c6c5a, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.594781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.620835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 946/1899] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:20 2022] PUT /identity/v3/projects/26063d9a1c1b497eb4a7be1ddcc53eb5/users/0aa2e932ffdd443c9b12e13d431c6c5a/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:20.630364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.630754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.631106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.676269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] MFA Rules not processed for user `0aa2e932ffdd443c9b12e13d431c6c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:20.679110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:20.762460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 954/1900] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:20.767507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.874780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66179b8-08ed-4bb9-bca2-070ba9eca23a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.880744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:20.881735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:20.882237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:20.882645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:20.883676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:20.885865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:20.933202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 947/1901] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:20 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:20.937531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.948828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e5783-e047-4db7-8471-60be15bbdb59 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:20.962986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:20.964801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:20.973055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:21.015542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.016251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.016526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.017025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.017132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:21.017738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.020179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.041454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 955/1902] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:20 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:21.044331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13478d-9520-4c5f-a346-e5c88a710501 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.045355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.049253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.050145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.050431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.050871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] PATH_INFO: `/v3/projects/3f9489f62f03498ca521bbbe4efcaf1b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.052060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9489f62f03498ca521bbbe4efcaf1b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.054044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.055151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e7d0c-91c6-49a9-bdbd-401eee220715 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.059749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.060440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.060763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.061073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.061801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.063415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.076519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 956/1903] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:21.077694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.087661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c672f-3389-411f-b782-fe1934238918 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.092270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.093172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.093454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.093726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] PATH_INFO: `/v3/projects/d6e4f3ce298c4b35ade43cacb4ed9e7b/users/ae7dbb343c844c8992c155f41a8b8aad/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.105744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9489f62f03498ca521bbbe4efcaf1b', 'request_id': 'req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.108717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e4f3ce298c4b35ade43cacb4ed9e7b, user_id=ae7dbb343c844c8992c155f41a8b8aad, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.111793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.112864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9489f62f03498ca521bbbe4efcaf1b', 'request_id': 'req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.122256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9489f62f03498ca521bbbe4efcaf1b', 'request_id': 'req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.125792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 957/1904] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:21 2022] PUT /identity/v3/projects/d6e4f3ce298c4b35ade43cacb4ed9e7b/users/ae7dbb343c844c8992c155f41a8b8aad/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:21.130149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.132945 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] The token cache is being invalidate because project 3f9489f62f03498ca521bbbe4efcaf1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:21.133240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.133914 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.135500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 948/1905] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:20 2022] DELETE /identity/v3/projects/3f9489f62f03498ca521bbbe4efcaf1b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:21.139718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.141048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:21.193862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef0c0-5bb6-4115-ad57-f66c49abf922 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.201258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.202053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.202394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.202724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.203469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.205389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.205556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9bbf-f818-497b-82f6-7a038bb1f1c4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.213976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.214936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.215161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.215445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] PATH_INFO: `/v3/users/2e6e5bce51d7496784bd6e4f74714e31` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.219808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 958/1906] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:21.219949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6e5bce51d7496784bd6e4f74714e31)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.219949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.221415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.223137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:21.237578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bddd8a-4007-4f56-81d7-e911bb97ab66 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.244389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacaf97-9dc3-4df8-9fe3-3f76ff440858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.245491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacaf97-9dc3-4df8-9fe3-3f76ff440858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.245842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacaf97-9dc3-4df8-9fe3-3f76ff440858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.246189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacaf97-9dc3-4df8-9fe3-3f76ff440858 admin admin] PATH_INFO: `/v3/projects/d6e4f3ce298c4b35ade43cacb4ed9e7b/users/ae7dbb343c844c8992c155f41a8b8aad/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.248576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacaf97-9dc3-4df8-9fe3-3f76ff440858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e4f3ce298c4b35ade43cacb4ed9e7b, user_id=ae7dbb343c844c8992c155f41a8b8aad, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.251726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacaf97-9dc3-4df8-9fe3-3f76ff440858 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.276772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 959/1907] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:21 2022] PUT /identity/v3/projects/d6e4f3ce298c4b35ade43cacb4ed9e7b/users/ae7dbb343c844c8992c155f41a8b8aad/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:21.278251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.278575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.278893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.291041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6e5bce51d7496784bd6e4f74714e31'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.292303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6e5bce51d7496784bd6e4f74714e31'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.315536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] MFA Rules not processed for user `ae7dbb343c844c8992c155f41a8b8aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:21.317030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:21.321076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6e5bce51d7496784bd6e4f74714e31'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.324335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:21.333671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6e5bce51d7496784bd6e4f74714e31'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.335004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6e5bce51d7496784bd6e4f74714e31'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:21.357610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 949/1908] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:21 2022] DELETE /identity/v3/users/2e6e5bce51d7496784bd6e4f74714e31 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:21.376960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:21.414404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 960/1909] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:21.428726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.435002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:21.530703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e096db-99cf-4915-9e76-8af9b89f3a35 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:21.536376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:21.537200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:21.537544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:21.537888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:21.682312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:21.684119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:21.701929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 950/1910] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:21.978614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:21.980132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:22.098801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc0d6-bb4f-4a0f-89c9-66835e173579 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:22.199829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:22.202423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:22.202907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:22.203668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] PATH_INFO: `/v3/projects/50da1af14ab44b8292d4bc11a0b8979d` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:22.205969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50da1af14ab44b8292d4bc11a0b8979d)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:22.208764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:22.315081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50da1af14ab44b8292d4bc11a0b8979d', 'request_id': 'req-9472e54b-0898-4bfa-ba1c-c1d9d167255f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.328038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50da1af14ab44b8292d4bc11a0b8979d', 'request_id': 'req-9472e54b-0898-4bfa-ba1c-c1d9d167255f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.337605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50da1af14ab44b8292d4bc11a0b8979d', 'request_id': 'req-9472e54b-0898-4bfa-ba1c-c1d9d167255f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.359358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] The token cache is being invalidate because project 50da1af14ab44b8292d4bc11a0b8979d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:22.359987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.360973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.366260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 961/1911] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:21 2022] DELETE /identity/v3/projects/50da1af14ab44b8292d4bc11a0b8979d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:22.367275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:22.380905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3155-e927-41f2-9c6f-76185aa5c472 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:22.470950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:22.471963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:22.472728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:22.472881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] PATH_INFO: `/v3/users/9cd65633d1dc4fd48ae93eb5e7f56666` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:22.474447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd65633d1dc4fd48ae93eb5e7f56666)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:22.477195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:22.536084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:22.543593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd65633d1dc4fd48ae93eb5e7f56666'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.544965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd65633d1dc4fd48ae93eb5e7f56666'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.561242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd65633d1dc4fd48ae93eb5e7f56666'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.577275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd65633d1dc4fd48ae93eb5e7f56666'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.579020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b81570ce-b0bf-469b-be82-68f6dd5477c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd65633d1dc4fd48ae93eb5e7f56666'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.599066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 951/1912] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:22 2022] DELETE /identity/v3/users/9cd65633d1dc4fd48ae93eb5e7f56666 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:22.609654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:22.611340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:22.628522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472e54b-0898-4bfa-ba1c-c1d9d167255f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:22.660469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:22.719504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:22.720752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:22.721051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:22.721344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] PATH_INFO: `/v3/users/0aa2e932ffdd443c9b12e13d431c6c5a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:22.723068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa2e932ffdd443c9b12e13d431c6c5a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:22.725565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:22.787822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa2e932ffdd443c9b12e13d431c6c5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.798490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa2e932ffdd443c9b12e13d431c6c5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.815113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa2e932ffdd443c9b12e13d431c6c5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.815875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa2e932ffdd443c9b12e13d431c6c5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.827263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa2e932ffdd443c9b12e13d431c6c5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:22.837810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 962/1913] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:22 2022] DELETE /identity/v3/users/0aa2e932ffdd443c9b12e13d431c6c5a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:22.842407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:22.842895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:22.843186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:22.864845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:22.866462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:22.917036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:22.918540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:22.946533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 952/1914] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:22.956502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:22.958073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:22.993310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787bfbb-4a39-42c8-ae77-17cfc7b49d5b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.000258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.002008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.002423 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.003327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] PATH_INFO: `/v3/projects/89d171d8e25e4e51b0a2f1609aaaf99a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.006081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d171d8e25e4e51b0a2f1609aaaf99a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.009433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.023501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c60f8-4ed0-4a9c-b46f-7c917ee55e2b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.027544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3a9f6-de17-4b5a-a407-f9dd5f06b568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.028222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a9f6-de17-4b5a-a407-f9dd5f06b568 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.028511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a9f6-de17-4b5a-a407-f9dd5f06b568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.028873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a9f6-de17-4b5a-a407-f9dd5f06b568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.046043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3a9f6-de17-4b5a-a407-f9dd5f06b568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.048567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3a9f6-de17-4b5a-a407-f9dd5f06b568 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.065890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:23.075435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 953/1915] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:23.081371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d171d8e25e4e51b0a2f1609aaaf99a', 'request_id': 'req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.095422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d171d8e25e4e51b0a2f1609aaaf99a', 'request_id': 'req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.110629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d171d8e25e4e51b0a2f1609aaaf99a', 'request_id': 'req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.136021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] The token cache is being invalidate because project 89d171d8e25e4e51b0a2f1609aaaf99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:23.136382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.137095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0c0f8321-6e5d-4652-824c-5c4ffc2bc9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.145802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 963/1916] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:22 2022] DELETE /identity/v3/projects/89d171d8e25e4e51b0a2f1609aaaf99a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:23.152206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.152567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.152939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.177360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:23.178738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.260431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:23.280174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 954/1917] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:23.291313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.291662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.291952 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.320201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:23.321419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.333650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 964/1918] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:23.341158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.346234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.348133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.348832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af731-a7ee-49b6-b139-a20597639f32 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.354076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.354740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.354963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.355245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.356087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:23.356406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.358129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.366709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f3e15-4941-4043-920c-c00a0812e9fb None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.373404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.374554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.375017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.375630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] PATH_INFO: `/v3/users/6d8bea66b0744f86bb35953d277502fc` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.377822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8bea66b0744f86bb35953d277502fc)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.380591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.406150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 955/1919] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:23.408160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.423853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dfc75-d3d4-4aad-9b3a-c6f1c7f4b2d3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.434968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.436108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.436823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.437481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.438464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.441238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.473040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8bea66b0744f86bb35953d277502fc'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.491337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8bea66b0744f86bb35953d277502fc'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.514484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 956/1920] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:23 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:23.516921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.526942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8bea66b0744f86bb35953d277502fc'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.528537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8bea66b0744f86bb35953d277502fc'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.544412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f2e4ad31-6221-4e41-8392-0f984fdd5bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8bea66b0744f86bb35953d277502fc'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.557611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 965/1921] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:23 2022] DELETE /identity/v3/users/6d8bea66b0744f86bb35953d277502fc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:23.562669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.562971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.563331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.598194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:23.603520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.658889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad19334-cc55-4466-911d-60c4af5b2fad admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.716433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 966/1922] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:23.716433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.716433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.730207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e1e6-3a35-49b0-9886-82ed37e30146 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:23.736727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.737750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.747273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.747934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] PATH_INFO: `/v3/projects/26063d9a1c1b497eb4a7be1ddcc53eb5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.749546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26063d9a1c1b497eb4a7be1ddcc53eb5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.751755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.777850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:23.779196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:23.779805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:23.780249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:23.781278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:23.784443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:23.842198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 957/1923] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:23 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:23.843315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.849467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.850043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:23.880169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26063d9a1c1b497eb4a7be1ddcc53eb5', 'request_id': 'req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.899146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26063d9a1c1b497eb4a7be1ddcc53eb5', 'request_id': 'req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.910694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26063d9a1c1b497eb4a7be1ddcc53eb5', 'request_id': 'req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.944540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] The token cache is being invalidate because project 26063d9a1c1b497eb4a7be1ddcc53eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:23.945099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.948287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:23.954155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 967/1924] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:23 2022] DELETE /identity/v3/projects/26063d9a1c1b497eb4a7be1ddcc53eb5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:23.955513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:23.960681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:23.983245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaacaa-f4a2-4abc-b02f-74834b441d78 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.021834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:24.129881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.130722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.130931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.131367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.139359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.154126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e0ac-bc49-46aa-98b3-d2f243e7df18 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.160845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.163325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.191961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.196327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.197048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.198785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.200516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 958/1925] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:24.201195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.201476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.207384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.210768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.232470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b861c-e8d2-486f-803c-099f3e7e84be service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.239611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.240581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.240956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.241238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] PATH_INFO: `/v3/users/ae7dbb343c844c8992c155f41a8b8aad` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.244849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7dbb343c844c8992c155f41a8b8aad)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.246969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.252508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 968/1926] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:24.256419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.282777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7f9d-9fd2-493a-88ed-65a9cd2517aa admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.294971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.298927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.299221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.299593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.301123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.303390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.319560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 969/1927] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:24.324269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.340442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225691-7810-48f7-822b-ef48c2491121 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.345898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf3e75-af7f-4828-bb73-bd14c781db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.347072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf3e75-af7f-4828-bb73-bd14c781db06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.347428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf3e75-af7f-4828-bb73-bd14c781db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.347732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf3e75-af7f-4828-bb73-bd14c781db06 admin admin] PATH_INFO: `/v3/projects/b4235f5e49744b12ba24578e6d9a768f/users/dd1dd87b067d4799b1a1390f85af5c0a/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.357167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7dbb343c844c8992c155f41a8b8aad'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.358221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7dbb343c844c8992c155f41a8b8aad'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.385103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf3e75-af7f-4828-bb73-bd14c781db06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4235f5e49744b12ba24578e6d9a768f, user_id=dd1dd87b067d4799b1a1390f85af5c0a, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.387840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf3e75-af7f-4828-bb73-bd14c781db06 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.397808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7dbb343c844c8992c155f41a8b8aad'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.423304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7dbb343c844c8992c155f41a8b8aad'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.429922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7dbb343c844c8992c155f41a8b8aad'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.443491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 970/1928] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:24 2022] PUT /identity/v3/projects/b4235f5e49744b12ba24578e6d9a768f/users/dd1dd87b067d4799b1a1390f85af5c0a/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:24.448382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.452032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.452482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.472713 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 959/1929] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:24 2022] DELETE /identity/v3/users/ae7dbb343c844c8992c155f41a8b8aad => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:24.495224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] MFA Rules not processed for user `dd1dd87b067d4799b1a1390f85af5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:24.500521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.594314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 971/1930] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:24.600022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.602769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.674014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9fc2-35c5-436d-97a4-410daa4bf1b0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.678618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.679306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.679589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.679870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.680581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.682545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.713178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 960/1931] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:24 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:24.714518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.731695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a5797-6c19-4043-870b-d1d6e604f8e9 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.740221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:24.775065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.777933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.804025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:24.825919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.827533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.827840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.828116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.829170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.832463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.862376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 972/1932] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:24 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:24.864761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.874749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f965-f06b-489f-91ae-588cdec3c25e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.876155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50c28-b150-42ac-85e5-e9d916a363b0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.879866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.880812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.881090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.881362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] PATH_INFO: `/v3/projects/945fc204602f45c89789722b9cd86a61` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.885347 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945fc204602f45c89789722b9cd86a61)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.885464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.886099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.886388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.886663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.887320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.887430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.889557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.904906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 973/1933] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:24.904906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.905541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.920148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b80b-5fd6-43a3-885b-09a409b801f9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:24.925341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:24.926280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:24.926593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:24.926849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] PATH_INFO: `/v3/projects/d6e4f3ce298c4b35ade43cacb4ed9e7b` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:24.928060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e4f3ce298c4b35ade43cacb4ed9e7b)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:24.930044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:24.946296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945fc204602f45c89789722b9cd86a61', 'request_id': 'req-46a23c11-badb-4ac7-bcfe-0ee842882059'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.952867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945fc204602f45c89789722b9cd86a61', 'request_id': 'req-46a23c11-badb-4ac7-bcfe-0ee842882059'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.962434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945fc204602f45c89789722b9cd86a61', 'request_id': 'req-46a23c11-badb-4ac7-bcfe-0ee842882059'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.973595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] The token cache is being invalidate because project 945fc204602f45c89789722b9cd86a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:24.974023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.974693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.976303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 961/1934] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:24 2022] DELETE /identity/v3/projects/945fc204602f45c89789722b9cd86a61 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:24.977114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:24.978397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:24.981618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e4f3ce298c4b35ade43cacb4ed9e7b', 'request_id': 'req-2ad321a2-0491-49e3-9cfc-077a37875e3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.990969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e4f3ce298c4b35ade43cacb4ed9e7b', 'request_id': 'req-2ad321a2-0491-49e3-9cfc-077a37875e3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:24.998233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e4f3ce298c4b35ade43cacb4ed9e7b', 'request_id': 'req-2ad321a2-0491-49e3-9cfc-077a37875e3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.010134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] The token cache is being invalidate because project d6e4f3ce298c4b35ade43cacb4ed9e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:25.010561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.011454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.013206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 974/1935] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:24 2022] DELETE /identity/v3/projects/d6e4f3ce298c4b35ade43cacb4ed9e7b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:25.014510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.016278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.072409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a23c11-badb-4ac7-bcfe-0ee842882059 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.102754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad321a2-0491-49e3-9cfc-077a37875e3b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.107633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.108739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.109096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.109432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] PATH_INFO: `/v3/users/6866001cb8a74214b7241ede7f2d3060` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.110702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6866001cb8a74214b7241ede7f2d3060)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.112863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:25.129626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:25.146702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:25.167594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79480-ef49-4598-98bb-25865305b633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.168644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79480-ef49-4598-98bb-25865305b633 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.169348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79480-ef49-4598-98bb-25865305b633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.169801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79480-ef49-4598-98bb-25865305b633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.171240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b79480-ef49-4598-98bb-25865305b633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.173431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b79480-ef49-4598-98bb-25865305b633 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:25.188422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6866001cb8a74214b7241ede7f2d3060'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.192273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 962/1936] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:25.192273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.192273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.192273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.196738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6866001cb8a74214b7241ede7f2d3060'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.210393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6866001cb8a74214b7241ede7f2d3060'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.211560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6866001cb8a74214b7241ede7f2d3060'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.219656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:25.221221 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.237855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-e9802e0d-66a0-4d0c-b897-b762d150a6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6866001cb8a74214b7241ede7f2d3060'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:25.244137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 963/1937] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:25.245226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.251506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.254387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 975/1938] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:25 2022] DELETE /identity/v3/users/6866001cb8a74214b7241ede7f2d3060 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:25.256045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.257386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.257678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.268875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3aa43-7ec9-4e9b-a114-0f59f585cb8c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.291912 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:25.293339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.345296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e347e31-c455-4c12-bcd6-773c12e0ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.346774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e347e31-c455-4c12-bcd6-773c12e0ed06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.347066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e347e31-c455-4c12-bcd6-773c12e0ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.347462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e347e31-c455-4c12-bcd6-773c12e0ed06 admin admin] PATH_INFO: `/v3/projects/421ae83548d744288bdaf3e674365eef/users/06473cba03ae4657b8785677da47b4b2/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.367074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e347e31-c455-4c12-bcd6-773c12e0ed06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421ae83548d744288bdaf3e674365eef, user_id=06473cba03ae4657b8785677da47b4b2, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.370405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e347e31-c455-4c12-bcd6-773c12e0ed06 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:25.390770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 964/1939] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:25 2022] PUT /identity/v3/projects/421ae83548d744288bdaf3e674365eef/users/06473cba03ae4657b8785677da47b4b2/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:25.401571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.401876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.402332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.442097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] MFA Rules not processed for user `06473cba03ae4657b8785677da47b4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:25.444506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.462755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 976/1940] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:25.463972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.490973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f11e2-de59-4950-b38d-be8e7e416329 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.629644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 965/1941] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:25.630637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.631554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.632568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.633027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.633454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.633963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:25.634747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:25.635478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.637980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:25.659029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3130b-13d8-4034-8dec-c60c5a0a31db None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.660947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 977/1942] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:25.665346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.669210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.669926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.670268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.670553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.671264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.673361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:25.684741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04c7f-a20e-41a8-9776-d334eb89886d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.700991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.701889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.702184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.702469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.703176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.705189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:25.746501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 966/1943] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:25.749176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.790886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 978/1944] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:25.794525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:25.806972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:25.858000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:25.926777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728685-65d8-45e4-a2b9-b470cc0fc4d1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.946728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899d6e-92d0-4076-ae67-f2c3d00fa0a6 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:25.952531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:25.953250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:25.953804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:25.954450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:25.955241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:25.958891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.008350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 979/1945] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:26.009746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.011331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.026285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b343988-c709-474a-8893-9d523709e866 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.026894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.027597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.027935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.028234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.029078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.031376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.034940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.036137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.038307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.038612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] PATH_INFO: `/v3/projects/a0e3c47793ef4c338865860e870ec592` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.040646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e3c47793ef4c338865860e870ec592)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.042255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.076892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 967/1946] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:25 2022] POST /identity/v3/users => generated 295 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:26.077837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.089445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941702-df71-48e9-8d38-b93d2f51c492 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.096290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.096988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.097277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.097558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.098340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.100951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.125608 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 968/1947] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:26.126943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.142226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d957-a54b-401e-aaf9-d0a4b41ec140 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.144721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e3c47793ef4c338865860e870ec592', 'request_id': 'req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:26.156804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e3c47793ef4c338865860e870ec592', 'request_id': 'req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:26.166971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e3c47793ef4c338865860e870ec592', 'request_id': 'req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:26.185700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] The token cache is being invalidate because project a0e3c47793ef4c338865860e870ec592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:26.186248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:26.187702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:26.189687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 980/1948] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:26 2022] DELETE /identity/v3/projects/a0e3c47793ef4c338865860e870ec592 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:26.191470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.199776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.237556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc81a-6078-4ed5-863a-eb96bdeb9530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.238538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc81a-6078-4ed5-863a-eb96bdeb9530 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.239075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc81a-6078-4ed5-863a-eb96bdeb9530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.239419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc81a-6078-4ed5-863a-eb96bdeb9530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.240273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc81a-6078-4ed5-863a-eb96bdeb9530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.242425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc81a-6078-4ed5-863a-eb96bdeb9530 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.257905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 969/1949] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:26.259278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.259576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.259856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.279062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cbc89-c3b7-4030-8b4c-f69fd6f40657 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.282171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:26.283467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.283986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99790c05-e975-4d9f-b52a-06f995286b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.284746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790c05-e975-4d9f-b52a-06f995286b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.285170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790c05-e975-4d9f-b52a-06f995286b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.285553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790c05-e975-4d9f-b52a-06f995286b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.286299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99790c05-e975-4d9f-b52a-06f995286b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.288585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99790c05-e975-4d9f-b52a-06f995286b06 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.291883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 970/1950] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:26.292741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.294082 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.305934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73204d47-a3bc-4be3-9a62-4977c344643a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.309814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 981/1951] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:26.309814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.309814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.309814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.311291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.312167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.312480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.312767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] PATH_INFO: `/v3/projects/b5e9613807274d9ca20215810a1edb27/users/42dcef1696be4640948793ef9cec44b3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.328011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e9613807274d9ca20215810a1edb27, user_id=42dcef1696be4640948793ef9cec44b3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.330744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.331627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:26.333077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.342667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 982/1952] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:26.343844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.350364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:26.354374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 971/1953] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:26 2022] PUT /identity/v3/projects/b5e9613807274d9ca20215810a1edb27/users/42dcef1696be4640948793ef9cec44b3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:26.354374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.355676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8977-6bc4-45e7-9275-cf59aaf9f0bc None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.385601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:26.430641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883216e-ca96-4f94-8848-d49fe2027dcd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.436098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.436913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.437293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.437388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.437760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.438616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:26.438728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.438944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.439255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] PATH_INFO: `/v3/projects/dc9662d4896a4797ba37e4625dc7bb9c/users/2ec32300ef6443f4884de1f1494c7b95/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.439364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.441231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.456755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 972/1954] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:26.456755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.459523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9662d4896a4797ba37e4625dc7bb9c, user_id=2ec32300ef6443f4884de1f1494c7b95, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.462309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.466636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe6dc8-beb8-476a-ae7b-3cdd599b7913 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.472223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c7e1-ab2b-4738-967a-ea1c689e8929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.473127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c7e1-ab2b-4738-967a-ea1c689e8929 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.473421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c7e1-ab2b-4738-967a-ea1c689e8929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.473704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c7e1-ab2b-4738-967a-ea1c689e8929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.474641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7c7e1-ab2b-4738-967a-ea1c689e8929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.476266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7c7e1-ab2b-4738-967a-ea1c689e8929 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.477117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 983/1955] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:26 2022] PUT /identity/v3/projects/dc9662d4896a4797ba37e4625dc7bb9c/users/2ec32300ef6443f4884de1f1494c7b95/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:26.478038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.487086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 973/1956] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:26.488730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.489100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.489693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.516412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] MFA Rules not processed for user `2ec32300ef6443f4884de1f1494c7b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:26.517716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.543871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b3cd-9c36-46c9-9b52-6133699c88b5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.548993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.549796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.550119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.550405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.551102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.553079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.580403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 984/1957] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:26.581425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.587112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 974/1958] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:26.588133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.601941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df38f31-2941-433b-bc7b-b78642205261 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.664521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fab739-5824-4be4-844e-08b0c130c261 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.671457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.672518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.672961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.673361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] PATH_INFO: `/v3/projects/b5e9613807274d9ca20215810a1edb27/users/42dcef1696be4640948793ef9cec44b3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.675693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e9613807274d9ca20215810a1edb27, user_id=42dcef1696be4640948793ef9cec44b3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.679071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.705416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c0595-f235-4bfa-b0ef-e1b368b4bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.706314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c0595-f235-4bfa-b0ef-e1b368b4bf7b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.706647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c0595-f235-4bfa-b0ef-e1b368b4bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.706975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c0595-f235-4bfa-b0ef-e1b368b4bf7b admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.707683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c0595-f235-4bfa-b0ef-e1b368b4bf7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.709910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c0595-f235-4bfa-b0ef-e1b368b4bf7b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.713434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 985/1959] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:26 2022] PUT /identity/v3/projects/b5e9613807274d9ca20215810a1edb27/users/42dcef1696be4640948793ef9cec44b3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:26.719512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.736365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:26.765115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 975/1960] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:26.771852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.772036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.772222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.818688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] MFA Rules not processed for user `42dcef1696be4640948793ef9cec44b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:26.820340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:26.835820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:26.845316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd2ea-f0f1-493f-90de-b8750cade68b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:26.853035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:26.853875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:26.854254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:26.855188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:26.856028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:26.858931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:26.904725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 986/1961] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:26.904725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.960306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 976/1962] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:26.961195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:26.996349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b8b5-4274-4bf4-9692-f49d9e407ac6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.000066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1263b-d220-42c2-b476-8f7e0166b9e7 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.005783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.006884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.007205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.007638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.008483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.008924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.009916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.010329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.010444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.011408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.012213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.015061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.029622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 987/1963] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:27.033928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.045709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a7db-5d2c-484b-a737-613cff817f81 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.050751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.051446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.051729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.052006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.052137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 977/1964] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:26 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:27.052843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.053247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.054581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.055100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:27.065647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 988/1965] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:27.066650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.076361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7ba5-4d53-4474-a0bd-57dda5ee5538 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.084354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.085535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.085848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.086133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.086882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.088591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.100000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 989/1966] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:27.100848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.110800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6fe39-98cf-4385-b0c0-bd7e4736011f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.114430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22063-d8a6-4aa9-89a5-f59166939a78 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.115580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.116470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.116797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.117076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] PATH_INFO: `/v3/projects/24a70241556146d199c2f5a9fdb18de9/users/b7e8852b50ed439d8b733edebe3ac323/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.118447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.119113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.119402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.119679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.121538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:27.131854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a70241556146d199c2f5a9fdb18de9, user_id=b7e8852b50ed439d8b733edebe3ac323, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.134601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.149766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 990/1967] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:27 2022] PUT /identity/v3/projects/24a70241556146d199c2f5a9fdb18de9/users/b7e8852b50ed439d8b733edebe3ac323/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:27.150866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.181573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.183049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae5826-4cb1-4540-9c32-6c9c5f314275 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.193802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 978/1968] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:27.198101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.198402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.198682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.210083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:27.228425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] MFA Rules not processed for user `b7e8852b50ed439d8b733edebe3ac323`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:27.229671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:27.233452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71387605-f69e-4c0c-a681-7e43da0e3992 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.239445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.240631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.240991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.241320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] PATH_INFO: `/v3/projects/c533506690684bd1801666e74ac5bc13/users/c1edbd835d8740609e0a33a7da9ee415/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.261424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c533506690684bd1801666e74ac5bc13, user_id=c1edbd835d8740609e0a33a7da9ee415, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.264718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.276535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:27.290663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 991/1969] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:27 2022] PUT /identity/v3/projects/c533506690684bd1801666e74ac5bc13/users/c1edbd835d8740609e0a33a7da9ee415/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:27.295129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.311846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 979/1970] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:27.316858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.330039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6de63-4ad7-40ad-813e-071a1c130201 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.399095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da8359-ef6e-44dd-a76d-1ca10a6d9d29 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.405787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.406526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.406839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.407117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.407933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.410041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.410239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.410894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.411278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.411573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.412462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.414566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.426784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 992/1971] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:27.432281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.449213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075ad2-cf9f-4483-8a6f-13cdc6639ffd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.457943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d48b7-26a4-4b08-8715-418db4e5f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.458940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d48b7-26a4-4b08-8715-418db4e5f947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.459230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d48b7-26a4-4b08-8715-418db4e5f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.459514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d48b7-26a4-4b08-8715-418db4e5f947 admin admin] PATH_INFO: `/v3/projects/c533506690684bd1801666e74ac5bc13/users/c1edbd835d8740609e0a33a7da9ee415/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.463063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 980/1972] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:27 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:27.464140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.467078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d48b7-26a4-4b08-8715-418db4e5f947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c533506690684bd1801666e74ac5bc13, user_id=c1edbd835d8740609e0a33a7da9ee415, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.475798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d48b7-26a4-4b08-8715-418db4e5f947 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.500332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 993/1973] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:27 2022] PUT /identity/v3/projects/c533506690684bd1801666e74ac5bc13/users/c1edbd835d8740609e0a33a7da9ee415/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:27.512290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.512290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.512290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.540721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbccef4-e593-4c82-8d12-05e3d6426960 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.580057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] MFA Rules not processed for user `c1edbd835d8740609e0a33a7da9ee415`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:27.581330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:27.657530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.658331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.658789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.659145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.660041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.662503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.684573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:27.699586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 981/1974] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:27 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:27.700682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.717716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 994/1975] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:27.723870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3e28-9ffb-49a9-a549-0f36c17149c3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.734262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.736585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.737309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.737598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.737888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.738839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.740521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.767846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 982/1976] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:27.772231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.791636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:27.804862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1837-cbea-4c1c-a7c3-349866121451 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.810302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.811257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.811539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.812403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] PATH_INFO: `/v3/projects/072ebc39b397412a8aa4243e016a9208/users/a56350391c5b4890ba3a2e0bf8f258c3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.817950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b320-8337-4de2-973f-13aec8c3348a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.822018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.822698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.824541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.824878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.837902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072ebc39b397412a8aa4243e016a9208, user_id=a56350391c5b4890ba3a2e0bf8f258c3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.838621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.840459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.841355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:27.855895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 995/1977] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:27.892731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 983/1978] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:27 2022] PUT /identity/v3/projects/072ebc39b397412a8aa4243e016a9208/users/a56350391c5b4890ba3a2e0bf8f258c3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:27.897183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.912346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e31e3-d037-41a5-a96a-32107cd4a24e service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:27.955031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:27.992442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:27.993220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:27.994151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:27.994151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:27.994630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:27.996441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:28.007856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 996/1979] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:28.012754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:28.023792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfdf76-7171-4c1f-83fb-a7912c25de5a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:28.028981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262124f-4251-45a6-88c6-eab3a888d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:28.029981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262124f-4251-45a6-88c6-eab3a888d108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:28.030270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262124f-4251-45a6-88c6-eab3a888d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:28.030391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aa72a-d57f-4c1f-8be4-408568853363 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:28.030551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262124f-4251-45a6-88c6-eab3a888d108 admin admin] PATH_INFO: `/v3/projects/072ebc39b397412a8aa4243e016a9208/users/a56350391c5b4890ba3a2e0bf8f258c3/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:28.032556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262124f-4251-45a6-88c6-eab3a888d108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072ebc39b397412a8aa4243e016a9208, user_id=a56350391c5b4890ba3a2e0bf8f258c3, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:28.034294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:28.035032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:28.035389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:28.035484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262124f-4251-45a6-88c6-eab3a888d108 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:28.035731 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:28.056150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 997/1980] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:28 2022] PUT /identity/v3/projects/072ebc39b397412a8aa4243e016a9208/users/a56350391c5b4890ba3a2e0bf8f258c3/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:28.068118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:28.068407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:28.070590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:28.127885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:28.129498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] MFA Rules not processed for user `a56350391c5b4890ba3a2e0bf8f258c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:28.130725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:28.131543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:28.155879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 984/1981] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:28.257164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 998/1982] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:28.315135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:28.329795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd6e9-2966-48da-9d7d-df61fc51b8c4 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:28.390774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:28.394011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:28.394488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:28.394894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:28.407947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:28.409781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:28.420492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 985/1983] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:28.560113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:28.569715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452face-3d26-4d18-b6c4-ecd201082070 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:28.573572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:28.574985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:28.575280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:28.575558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:28.620669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:28.641242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:28.643462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:28.658129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 999/1984] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:29.025878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:29.034890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e057247-2f1b-4025-867a-912497b32616 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:29.038636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f89408-232a-476e-b733-029c79600726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:29.039495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f89408-232a-476e-b733-029c79600726 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:29.039650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f89408-232a-476e-b733-029c79600726 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:29.040043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f89408-232a-476e-b733-029c79600726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:29.041878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-43f89408-232a-476e-b733-029c79600726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:29.063056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:29.116952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f89408-232a-476e-b733-029c79600726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:29.118681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f89408-232a-476e-b733-029c79600726 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:29.128882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 986/1985] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:29.272163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:29.353245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee450-2af1-4c70-a797-992d902683dc service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:29.360031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:29.361054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:29.361776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:29.361776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] PATH_INFO: `/v3/users/b7e8852b50ed439d8b733edebe3ac323` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:29.363682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e8852b50ed439d8b733edebe3ac323)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:29.365936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:29.439107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e8852b50ed439d8b733edebe3ac323'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:29.451245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e8852b50ed439d8b733edebe3ac323'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:29.467058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e8852b50ed439d8b733edebe3ac323'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:29.468042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e8852b50ed439d8b733edebe3ac323'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:29.478419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e8852b50ed439d8b733edebe3ac323'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:29.485633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1000/1986] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:29 2022] DELETE /identity/v3/users/b7e8852b50ed439d8b733edebe3ac323 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:29.490365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:29.490710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:29.490935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:29.516742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:29.518825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:29.607824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 987/1987] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:29.618003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:29.619579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:29.700249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e548f-f16b-4585-a418-26d6e48ebae5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:29.705160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:29.706184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:29.706699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:29.707234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:29.719994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:29.721961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:29.745021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1001/1988] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:29.908003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:29.910080 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:30.002913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af182-31a7-4ff5-b205-e1938e5ab117 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:30.018525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:30.019482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:30.019769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:30.020525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:30.022580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:30.110296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:30.112166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:30.113855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:30.115348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:30.128318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 988/1989] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:30.128857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:30.133777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f8eb9-d1a4-47d5-98a8-6062fc2dd8ad service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:30.142144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:30.143384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:30.144059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:30.144516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] PATH_INFO: `/v3/projects/24a70241556146d199c2f5a9fdb18de9` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:30.148665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a70241556146d199c2f5a9fdb18de9)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:30.153117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:30.242420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a70241556146d199c2f5a9fdb18de9', 'request_id': 'req-bb1f0007-dd09-406c-ae40-c5dfd12602b6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.255339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a70241556146d199c2f5a9fdb18de9', 'request_id': 'req-bb1f0007-dd09-406c-ae40-c5dfd12602b6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.274040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a70241556146d199c2f5a9fdb18de9', 'request_id': 'req-bb1f0007-dd09-406c-ae40-c5dfd12602b6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.292358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] The token cache is being invalidate because project 24a70241556146d199c2f5a9fdb18de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:30.294022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.296504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.302147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1002/1990] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:30 2022] DELETE /identity/v3/projects/24a70241556146d199c2f5a9fdb18de9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:30.309921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:30.363971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883aad-e864-41f0-b201-790f291dfab7 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:30.403881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:30.522224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:30.524108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:30.525963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:30.526489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] PATH_INFO: `/v3/users/a56350391c5b4890ba3a2e0bf8f258c3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:30.529648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56350391c5b4890ba3a2e0bf8f258c3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:30.533544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:30.648912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56350391c5b4890ba3a2e0bf8f258c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.648912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56350391c5b4890ba3a2e0bf8f258c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.680560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56350391c5b4890ba3a2e0bf8f258c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.692169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56350391c5b4890ba3a2e0bf8f258c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.693008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3c7cbc63-c485-4060-9328-c861f6e9ad39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56350391c5b4890ba3a2e0bf8f258c3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:30.717518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 989/1991] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:30 2022] DELETE /identity/v3/users/a56350391c5b4890ba3a2e0bf8f258c3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:31.321500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.323013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:31.337053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f0007-dd09-406c-ae40-c5dfd12602b6 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.399980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.400908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.401190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.401475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] PATH_INFO: `/v3/projects/072ebc39b397412a8aa4243e016a9208` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.402686 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072ebc39b397412a8aa4243e016a9208)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:31.404749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:31.460094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072ebc39b397412a8aa4243e016a9208', 'request_id': 'req-2257e087-49b2-4e06-a361-30bd4ed78a60'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:31.469895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072ebc39b397412a8aa4243e016a9208', 'request_id': 'req-2257e087-49b2-4e06-a361-30bd4ed78a60'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:31.478652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072ebc39b397412a8aa4243e016a9208', 'request_id': 'req-2257e087-49b2-4e06-a361-30bd4ed78a60'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:31.491954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] The token cache is being invalidate because project 072ebc39b397412a8aa4243e016a9208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:31.492294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:31.492975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2257e087-49b2-4e06-a361-30bd4ed78a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:31.495970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1003/1992] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:31 2022] DELETE /identity/v3/projects/072ebc39b397412a8aa4243e016a9208 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:31.501860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.502431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.502431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.521969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:31.523106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:31.590454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 990/1993] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:31.599005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.599356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.599705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.620764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:31.622630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:31.636736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1004/1994] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:31.641269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.656913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb0a8-e2ea-48fe-8927-75254252e8d2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.665095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.666096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.666646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.667130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.668269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:31.668812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:31.680251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:31.726958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 991/1995] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:31.731180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.741527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe5008-2e83-4694-b7dc-1cddfb3bcf23 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.748643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.748643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.748948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.749105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.749794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:31.751770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:31.761987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:31.787379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1005/1996] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:31 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:31.789961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.806308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbdc19-f587-45b2-a948-7af6ebcdd1c8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.819972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:31.874053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.874858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.875340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.875748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.881006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:31.883250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:31.908260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 992/1997] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:31 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:31.909585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.919886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1a92-aef0-406e-8d2f-d2592b958534 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.924803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.925487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.925774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.926053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.926788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:31.928421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:31.939025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1006/1998] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:31.943024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.953204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7568742-97a5-4b8e-8ff6-c48194ede2d8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.957818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ece102-6f2a-4e73-bb86-e0c6f784213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.958511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ece102-6f2a-4e73-bb86-e0c6f784213a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.958797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ece102-6f2a-4e73-bb86-e0c6f784213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.959079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ece102-6f2a-4e73-bb86-e0c6f784213a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:31.959813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ece102-6f2a-4e73-bb86-e0c6f784213a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:31.961466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ece102-6f2a-4e73-bb86-e0c6f784213a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:31.972786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 993/1999] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:31.976728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:31.988569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc475c-3702-4721-9a97-98c584a0bdc2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:31.994204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:31.995160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:31.995456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:31.995730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] PATH_INFO: `/v3/projects/8e62b419e6cb4352bf7796ab539e415e/users/2124e4e29950421398972d90d802e46f/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.011787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e62b419e6cb4352bf7796ab539e415e, user_id=2124e4e29950421398972d90d802e46f, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.014943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.032934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1007/2000] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:31 2022] PUT /identity/v3/projects/8e62b419e6cb4352bf7796ab539e415e/users/2124e4e29950421398972d90d802e46f/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:32.044501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.045173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.045542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.093258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] MFA Rules not processed for user `2124e4e29950421398972d90d802e46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:32.094693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:32.212496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 994/2001] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:32.218799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.365244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f93ea-f63a-4391-b6e9-2acf46aefde2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.370295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.370986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.371275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.371556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.372262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.374672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.409840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1008/2002] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:32 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:32.410073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.422209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e0e7a-9b94-4075-a0f4-fb3bed8c4775 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.488303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.489070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.489528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.489810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.490570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.492565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.517839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 995/2003] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:32 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:32.522001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.532944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830312d-5430-4702-be2c-29806c3e7971 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.538389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.539590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.539874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.540546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.541465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.543156 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.570569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1009/2004] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:32.574831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.590592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af4d3-2668-4bdb-89b8-f4bd5b72431e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.595446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.596402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.596726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.597010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] PATH_INFO: `/v3/projects/cb365e285c914e829a538468004a1b20/users/85573ba8f2b84935933d6699e530844a/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.611455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:32.615110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb365e285c914e829a538468004a1b20, user_id=85573ba8f2b84935933d6699e530844a, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.618639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.636737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 996/2005] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:32 2022] PUT /identity/v3/projects/cb365e285c914e829a538468004a1b20/users/85573ba8f2b84935933d6699e530844a/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:32.641784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.654874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300974ff-b4ff-4fa7-8b04-8dae088f6bf4 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.714283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b832-b535-4388-84f9-91c0765a5bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.714967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b832-b535-4388-84f9-91c0765a5bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.715264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b832-b535-4388-84f9-91c0765a5bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.715538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b832-b535-4388-84f9-91c0765a5bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.716270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b832-b535-4388-84f9-91c0765a5bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.718169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b832-b535-4388-84f9-91c0765a5bc1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.732146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1010/2006] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:32.733496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.746109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3be29-5df9-46b8-80d9-c568e22754fe admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.752406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.755479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.755794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.756150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] PATH_INFO: `/v3/projects/cb365e285c914e829a538468004a1b20/users/85573ba8f2b84935933d6699e530844a/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.758642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb365e285c914e829a538468004a1b20, user_id=85573ba8f2b84935933d6699e530844a, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:32.761650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:32.780389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 997/2007] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:32 2022] PUT /identity/v3/projects/cb365e285c914e829a538468004a1b20/users/85573ba8f2b84935933d6699e530844a/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:32.788179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048330d-0d51-447c-a277-0e426ade02cd None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.788496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048330d-0d51-447c-a277-0e426ade02cd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.788811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048330d-0d51-447c-a277-0e426ade02cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:32.835060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9048330d-0d51-447c-a277-0e426ade02cd None None] MFA Rules not processed for user `85573ba8f2b84935933d6699e530844a`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:32.836284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9048330d-0d51-447c-a277-0e426ade02cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:32.848366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:32.912047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1011/2008] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:32.923464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:32.925645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:32.985604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a18b73-5670-42ba-baea-94cbf45294ae admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:32.989292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0de6-3227-45b6-a53b-db89c454f8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:32.989962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0de6-3227-45b6-a53b-db89c454f8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:32.990246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0de6-3227-45b6-a53b-db89c454f8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:32.990523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0de6-3227-45b6-a53b-db89c454f8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:33.051460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0de6-3227-45b6-a53b-db89c454f8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:33.052970 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0de6-3227-45b6-a53b-db89c454f8d1 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:33.061916 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 998/2009] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:36.489678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531b73-95e5-4998-8ffb-2532122094ba None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:36.490201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531b73-95e5-4998-8ffb-2532122094ba None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:36.490294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531b73-95e5-4998-8ffb-2532122094ba None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:36.491868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1012/2010] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:18:36.517985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:36.518460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:36.518583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:36.538965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] MFA Rules not processed for user `08c27893964a4cc2a798f33a91844833`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:36.540401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:36.556522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae531b73-95e5-4998-8ffb-2532122094ba None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:36.559004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ae531b73-95e5-4998-8ffb-2532122094ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:36.615868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 999/2011] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:36.627242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:36.628852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:36.628962 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae531b73-95e5-4998-8ffb-2532122094ba None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:36.633636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:36.634548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:36.634828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:36.635104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] PATH_INFO: `/v3/users/40c00c0bcb534a5a969bff4651cef40c` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:36.636391 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c00c0bcb534a5a969bff4651cef40c)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:36.638799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:36.643171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179f1aa-4cb3-403b-bb06-18c41005d37b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:36.649565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:36.650263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:36.650560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:36.650870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:36.660127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:36.661848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:36.677043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1000/2012] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:36.692433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c00c0bcb534a5a969bff4651cef40c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:36.701274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c00c0bcb534a5a969bff4651cef40c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:36.715809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c00c0bcb534a5a969bff4651cef40c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:36.716561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c00c0bcb534a5a969bff4651cef40c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:36.724789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c00c0bcb534a5a969bff4651cef40c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:36.730824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1013/2013] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:36 2022] DELETE /identity/v3/users/40c00c0bcb534a5a969bff4651cef40c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:36.918390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:36.936185 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ed99a-4ca2-48ed-8062-945888854328 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:36.950177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:37.000396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:37.001310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.001597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.001901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] PATH_INFO: `/v3/projects/811b15b0bb0048b28700714556dde299` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.003083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811b15b0bb0048b28700714556dde299)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:37.005077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:37.054868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811b15b0bb0048b28700714556dde299', 'request_id': 'req-4dfe742f-405d-46be-93c5-afd74bdd6eb3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.061100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811b15b0bb0048b28700714556dde299', 'request_id': 'req-4dfe742f-405d-46be-93c5-afd74bdd6eb3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.072194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811b15b0bb0048b28700714556dde299', 'request_id': 'req-4dfe742f-405d-46be-93c5-afd74bdd6eb3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.084809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] The token cache is being invalidate because project 811b15b0bb0048b28700714556dde299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:37.085269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.086400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.088493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1001/2014] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:36 2022] DELETE /identity/v3/projects/811b15b0bb0048b28700714556dde299 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:37.092925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:37.094500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:37.110664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603581e-7cd5-4c87-9428-75d5e5a3a10c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:37.145829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:37.179814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:37.180761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.181177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.181284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] PATH_INFO: `/v3/users/1748a1baeabd42f8b465aacedb3f24c6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.182472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1748a1baeabd42f8b465aacedb3f24c6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:37.184464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:37.233419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1748a1baeabd42f8b465aacedb3f24c6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.240689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1748a1baeabd42f8b465aacedb3f24c6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.252964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1748a1baeabd42f8b465aacedb3f24c6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.253692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1748a1baeabd42f8b465aacedb3f24c6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.261719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-71fb3cef-d0e4-41bd-b25a-ee9684d196dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1748a1baeabd42f8b465aacedb3f24c6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.269081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1014/2015] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:37 2022] DELETE /identity/v3/users/1748a1baeabd42f8b465aacedb3f24c6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:37.449095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:37.451621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:37.482996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe742f-405d-46be-93c5-afd74bdd6eb3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:37.550851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:37.551795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.552071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.552348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] PATH_INFO: `/v3/projects/eb9bb36d68bc425a8570070b71dcf304` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.553635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9bb36d68bc425a8570070b71dcf304)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:37.555595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:37.608374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:37.610036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9bb36d68bc425a8570070b71dcf304', 'request_id': 'req-681bd89f-0a35-4135-b4fc-0157630eb184'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.618170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9bb36d68bc425a8570070b71dcf304', 'request_id': 'req-681bd89f-0a35-4135-b4fc-0157630eb184'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.627840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9bb36d68bc425a8570070b71dcf304', 'request_id': 'req-681bd89f-0a35-4135-b4fc-0157630eb184'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.639198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] The token cache is being invalidate because project eb9bb36d68bc425a8570070b71dcf304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:37.639482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.640123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-681bd89f-0a35-4135-b4fc-0157630eb184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:37.641853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1002/2016] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:37 2022] DELETE /identity/v3/projects/eb9bb36d68bc425a8570070b71dcf304 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:37.647227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017917b9-a3df-4742-b231-f75248da337e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.647820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017917b9-a3df-4742-b231-f75248da337e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.648002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017917b9-a3df-4742-b231-f75248da337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.666830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-017917b9-a3df-4742-b231-f75248da337e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:37.668135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-017917b9-a3df-4742-b231-f75248da337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:37.732331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1015/2017] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:37.740769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.741064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.741345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.760792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:37.762022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:37.779966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1003/2018] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:37.784161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017917b9-a3df-4742-b231-f75248da337e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:37.795704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017917b9-a3df-4742-b231-f75248da337e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:37.800824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:37.801512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.802380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.802380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.802776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:37.803081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:37.804720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:37.824644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1016/2019] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:37.826667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:37.838313 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416885-4630-45de-87ab-0b3b232bdc9f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:37.844428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:37.845270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.845559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.845847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.846646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:37.848644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:37.880663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1004/2020] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:37 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:37.882290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:37.893629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d40c1-eaf9-460b-bb70-9f940c564109 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:37.931532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:37.957526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:37.958212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:37.958487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:37.958761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:37.959455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:37.961438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:37.984456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1017/2021] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:37 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:37.988785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:37.999024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a6eac-8708-4809-8cf0-8f231ca168e4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:38.003946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:38.004665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.004980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.005239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.005979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:38.007617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:38.018906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1005/2022] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:38.023496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:38.034179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd4a7-167f-4ea8-9ba9-7b1b852f8c02 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:38.040772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d316-5650-456b-927f-5692cd6a1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:38.041503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d316-5650-456b-927f-5692cd6a1373 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.041791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d316-5650-456b-927f-5692cd6a1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.042070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d316-5650-456b-927f-5692cd6a1373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.042818 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950d316-5650-456b-927f-5692cd6a1373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:38.044437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950d316-5650-456b-927f-5692cd6a1373 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:38.054798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1018/2023] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:38.059289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:38.071702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911562f-905a-40ac-87ea-5b1ecab0af32 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:38.077182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:38.078102 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.078391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.078666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] PATH_INFO: `/v3/projects/30719f0f69ca4e248d5da68bd1f79296/users/c8efd1486a8a42e4a5ab4822258f6498/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.094333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30719f0f69ca4e248d5da68bd1f79296, user_id=c8efd1486a8a42e4a5ab4822258f6498, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:38.097079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:38.111833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1006/2024] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:38 2022] PUT /identity/v3/projects/30719f0f69ca4e248d5da68bd1f79296/users/c8efd1486a8a42e4a5ab4822258f6498/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:38.123244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769872-baff-4f93-a444-6394d1477786 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.123568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769872-baff-4f93-a444-6394d1477786 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.123851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769872-baff-4f93-a444-6394d1477786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.156046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-06769872-baff-4f93-a444-6394d1477786 None None] MFA Rules not processed for user `c8efd1486a8a42e4a5ab4822258f6498`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:38.157346 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-06769872-baff-4f93-a444-6394d1477786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:38.228913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1019/2025] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:38.236812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:38.238758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:38.298496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc64bb-5561-48ab-ae70-7c19fb6ed865 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:38.302719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e038e-ac9c-4a48-b9df-fd2b4d246341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:38.303419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e038e-ac9c-4a48-b9df-fd2b4d246341 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.303710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e038e-ac9c-4a48-b9df-fd2b4d246341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.303991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e038e-ac9c-4a48-b9df-fd2b4d246341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.312965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e038e-ac9c-4a48-b9df-fd2b4d246341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:38.314439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e038e-ac9c-4a48-b9df-fd2b4d246341 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:38.323794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1007/2026] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:38.343757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06769872-baff-4f93-a444-6394d1477786 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:38.411694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06769872-baff-4f93-a444-6394d1477786 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:38.417813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:38.418716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.418999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.419287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] PATH_INFO: `/v3/users/c8efd1486a8a42e4a5ab4822258f6498` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.420586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8efd1486a8a42e4a5ab4822258f6498)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:38.422544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:38.481762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:38.483589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8efd1486a8a42e4a5ab4822258f6498'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:38.491775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8efd1486a8a42e4a5ab4822258f6498'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:38.503562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8efd1486a8a42e4a5ab4822258f6498'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:38.504262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8efd1486a8a42e4a5ab4822258f6498'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:38.512502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8efd1486a8a42e4a5ab4822258f6498'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:38.518862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1020/2027] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:38 2022] DELETE /identity/v3/users/c8efd1486a8a42e4a5ab4822258f6498 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:38.523632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.523947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.524235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.541496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:38.542737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:38.606918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1008/2028] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:38.616716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:38.618378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:38.676657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa5c2f-8641-40d8-a4dc-10d10f020f59 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:38.681186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1522-eeab-45dd-977c-1504e0777651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:38.681886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1522-eeab-45dd-977c-1504e0777651 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:38.682148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1522-eeab-45dd-977c-1504e0777651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:38.682427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1522-eeab-45dd-977c-1504e0777651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:38.692880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1522-eeab-45dd-977c-1504e0777651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:38.694364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1522-eeab-45dd-977c-1504e0777651 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:38.705031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1021/2029] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:38.982861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:38.985099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:38.997737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c36d1-b7a1-4cf6-9057-a4fb8cc786af None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.002641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.003557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.003877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.004177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] PATH_INFO: `/v3/projects/30719f0f69ca4e248d5da68bd1f79296` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.005408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30719f0f69ca4e248d5da68bd1f79296)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.007405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.019643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:39.077581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30719f0f69ca4e248d5da68bd1f79296', 'request_id': 'req-88908de3-4145-4255-84e3-a36c05200685'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.089456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30719f0f69ca4e248d5da68bd1f79296', 'request_id': 'req-88908de3-4145-4255-84e3-a36c05200685'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.106025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30719f0f69ca4e248d5da68bd1f79296', 'request_id': 'req-88908de3-4145-4255-84e3-a36c05200685'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.122550 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] The token cache is being invalidate because project 30719f0f69ca4e248d5da68bd1f79296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:39.123398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.125046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-88908de3-4145-4255-84e3-a36c05200685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.127394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1009/2030] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:38 2022] DELETE /identity/v3/projects/30719f0f69ca4e248d5da68bd1f79296 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:39.132099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.132438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.132721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.158284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:39.159536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:39.219038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1022/2031] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:39.226612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.226935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.227219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.246097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:39.247307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:39.255236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1010/2032] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:39.259670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.270474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b1bc-da89-4572-981a-e56a73b8c8c1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.275957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.276653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.276946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.277222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.278022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:39.278337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.280007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.292675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1023/2033] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:39.296926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.306404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3e7fd-4a6d-41b9-ac46-16e9968302f7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.311140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.311813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.312103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.312414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.313160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.315098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.341930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1011/2034] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:39 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:39.346264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.356873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527357e4-2d72-4145-999a-79dc28a25312 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.405904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:39.416668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.417593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.417946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.418462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.419170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.421226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.448457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1024/2035] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:39 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:39.453435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.467048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a21a8-cc6f-472c-8dc1-ee89eadfadd1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.472435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.473164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.473448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.473718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.474582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.476357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.487251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1012/2036] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:39.491259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.504404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a45a2-d62b-4e04-a25c-64eef3518383 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.512079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9dd4a-af56-4e37-9cd8-bceb8ee86752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.512791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9dd4a-af56-4e37-9cd8-bceb8ee86752 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.513825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9dd4a-af56-4e37-9cd8-bceb8ee86752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.514107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9dd4a-af56-4e37-9cd8-bceb8ee86752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.514908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9dd4a-af56-4e37-9cd8-bceb8ee86752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.516529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9dd4a-af56-4e37-9cd8-bceb8ee86752 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.528171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1025/2037] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:39.532675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.542934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda147fb-4f95-4f58-9363-ecb4b837742a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.548072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.549008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.549291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.549568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] PATH_INFO: `/v3/projects/e968e1cb276743ea91b6c5c18ab87078/users/a536d92c614249d79648ac99ce24d923/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.565407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e968e1cb276743ea91b6c5c18ab87078, user_id=a536d92c614249d79648ac99ce24d923, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.568115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.582473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1013/2038] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:39 2022] PUT /identity/v3/projects/e968e1cb276743ea91b6c5c18ab87078/users/a536d92c614249d79648ac99ce24d923/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:39.592692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.593237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.593615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.621076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] MFA Rules not processed for user `a536d92c614249d79648ac99ce24d923`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:39.622305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:39.688866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1026/2039] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:39.700229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.702148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:39.770038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c418e7-be09-4388-959a-9d294f340ac7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.774275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae221a2-c969-4043-95b1-2443219b1b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.774921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae221a2-c969-4043-95b1-2443219b1b92 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.775228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae221a2-c969-4043-95b1-2443219b1b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.775493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae221a2-c969-4043-95b1-2443219b1b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.784538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae221a2-c969-4043-95b1-2443219b1b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.786029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae221a2-c969-4043-95b1-2443219b1b92 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.795426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1014/2040] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:39.814386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:39.879742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe0005-b9a0-44de-aec2-01e126d0becd None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:39.884643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:39.885547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.885828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.886099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] PATH_INFO: `/v3/users/a536d92c614249d79648ac99ce24d923` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:39.887284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a536d92c614249d79648ac99ce24d923)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:39.889695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:39.948150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a536d92c614249d79648ac99ce24d923'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.955004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a536d92c614249d79648ac99ce24d923'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.960169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:39.968061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a536d92c614249d79648ac99ce24d923'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.968949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a536d92c614249d79648ac99ce24d923'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.977194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a536d92c614249d79648ac99ce24d923'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:39.983026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1027/2041] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:39 2022] DELETE /identity/v3/users/a536d92c614249d79648ac99ce24d923 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:39.987753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:39.988052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:39.988342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.005897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:40.007124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:40.043092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:40.071945 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1015/2042] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:40.082145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.083689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:40.148139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c327b-e061-4930-bab1-5dc89e132a0f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.151996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad81ae-565d-4e07-bc68-ecb6782ca564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.152703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad81ae-565d-4e07-bc68-ecb6782ca564 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.152983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad81ae-565d-4e07-bc68-ecb6782ca564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.153254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad81ae-565d-4e07-bc68-ecb6782ca564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.166129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad81ae-565d-4e07-bc68-ecb6782ca564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.167911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad81ae-565d-4e07-bc68-ecb6782ca564 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.180845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1028/2043] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:40.454797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.456358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:40.469440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f395af-1cf3-4412-9c76-37cb5e88cc8c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.474821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.476492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.476852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.477168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] PATH_INFO: `/v3/projects/e968e1cb276743ea91b6c5c18ab87078` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.478384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e968e1cb276743ea91b6c5c18ab87078)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.480322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.530093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e968e1cb276743ea91b6c5c18ab87078', 'request_id': 'req-8984f965-00e8-403f-8f41-50bff1c783ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:40.536361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e968e1cb276743ea91b6c5c18ab87078', 'request_id': 'req-8984f965-00e8-403f-8f41-50bff1c783ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:40.546019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e968e1cb276743ea91b6c5c18ab87078', 'request_id': 'req-8984f965-00e8-403f-8f41-50bff1c783ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:40.556626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] The token cache is being invalidate because project e968e1cb276743ea91b6c5c18ab87078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:40.556925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:40.557576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8984f965-00e8-403f-8f41-50bff1c783ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:40.559252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1016/2044] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:40 2022] DELETE /identity/v3/projects/e968e1cb276743ea91b6c5c18ab87078 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:40.564332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.564739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.565091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.583828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:40.585091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:40.645208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1029/2045] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:40.653923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.654242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.654521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.673783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:40.675097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:40.683396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1017/2046] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:40.687792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.697588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f83cb-1e5a-44b4-bcbf-fd5d7caf866b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.702819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.703517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.703800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.704078 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.704802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:40.705110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.706757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.719585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1030/2047] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:40.723907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.733747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaf94e-82ae-4db1-a2cd-47c891957f1f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.739083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.739784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.740069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.740346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.741086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.743110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.777229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1018/2048] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:40 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:40.778488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.793233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c895-5974-4527-aa35-2f8178ac8c80 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.849179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.849870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.850149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.850428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.851138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.853164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.872370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:40.879743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1031/2049] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:40 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:40.882958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.895730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff74de-48b2-4d6d-8f41-8c946dfd8590 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.900682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.901366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.901658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.901963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.902699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.904387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.915067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1019/2050] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:40.921424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.933879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8e20-e21b-401e-9dae-9a0459dd8cc9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.939534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83c610-9379-433e-8467-dc3f21b25ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.940216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83c610-9379-433e-8467-dc3f21b25ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.940503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83c610-9379-433e-8467-dc3f21b25ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.940816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83c610-9379-433e-8467-dc3f21b25ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.941824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83c610-9379-433e-8467-dc3f21b25ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:40.943542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83c610-9379-433e-8467-dc3f21b25ee5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:40.955491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1032/2051] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:40.959594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:40.972509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a83e7-2577-42fc-82d2-626b61b1a1b5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:40.978129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:40.979125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:40.979522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:40.979920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] PATH_INFO: `/v3/projects/a429cc84f87c4acea8a43c256d079ecc/users/7175536238b4464682f8b7a7beb509f3/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:40.998656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a429cc84f87c4acea8a43c256d079ecc, user_id=7175536238b4464682f8b7a7beb509f3, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:41.001915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:41.025490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1020/2052] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:40 2022] PUT /identity/v3/projects/a429cc84f87c4acea8a43c256d079ecc/users/7175536238b4464682f8b7a7beb509f3/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:41.027339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:41.027636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:41.027919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:41.055420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] MFA Rules not processed for user `7175536238b4464682f8b7a7beb509f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:41.056593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:41.130026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1033/2053] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:41.142092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:41.143819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:41.207248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf652f1-707f-42f1-b99f-70bdec5d7704 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:41.210996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebaa95-5202-47a4-972a-bdd2a45102fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:41.211698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebaa95-5202-47a4-972a-bdd2a45102fd service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:41.211987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebaa95-5202-47a4-972a-bdd2a45102fd service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:41.212262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebaa95-5202-47a4-972a-bdd2a45102fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:41.222831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebaa95-5202-47a4-972a-bdd2a45102fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:41.224473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebaa95-5202-47a4-972a-bdd2a45102fd service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:41.232206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:41.240001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1021/2054] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:41.690090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:41.691698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:41.805192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7eaca-b471-4448-8aee-3f984b5c2352 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:41.812021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:41.813822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:41.814233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:41.814519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] PATH_INFO: `/v3/users/dd1dd87b067d4799b1a1390f85af5c0a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:41.815784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1dd87b067d4799b1a1390f85af5c0a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:41.817838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:41.869934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1dd87b067d4799b1a1390f85af5c0a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:41.876947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1dd87b067d4799b1a1390f85af5c0a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:41.889815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1dd87b067d4799b1a1390f85af5c0a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:41.890507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1dd87b067d4799b1a1390f85af5c0a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:41.898549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1dd87b067d4799b1a1390f85af5c0a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:41.900098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:41.909195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1034/2055] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:41 2022] DELETE /identity/v3/users/dd1dd87b067d4799b1a1390f85af5c0a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:41.910969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:41.911449 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:41.911539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:41.929338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:41.930947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:41.954723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:41.956229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:42.031263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1022/2056] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:42.047735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:42.048892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0504-1cd3-4904-ab14-82161e02886a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:42.049337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:42.054518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:42.055438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.056258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.056258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] PATH_INFO: `/v3/users/2124e4e29950421398972d90d802e46f` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.057377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2124e4e29950421398972d90d802e46f)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:42.059275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:42.115494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474545a-61ff-40a0-8d20-f3538d52872b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:42.119770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbb419-f1bb-4280-82e2-85581b0413c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:42.120517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbb419-f1bb-4280-82e2-85581b0413c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.121680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbb419-f1bb-4280-82e2-85581b0413c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.121680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbb419-f1bb-4280-82e2-85581b0413c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.126511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2124e4e29950421398972d90d802e46f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.131383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbb419-f1bb-4280-82e2-85581b0413c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:42.133183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbb419-f1bb-4280-82e2-85581b0413c5 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:42.134121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2124e4e29950421398972d90d802e46f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.143945 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1023/2057] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:42.156575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2124e4e29950421398972d90d802e46f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.157739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2124e4e29950421398972d90d802e46f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.169117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2124e4e29950421398972d90d802e46f'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.182228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1035/2058] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:41 2022] DELETE /identity/v3/users/2124e4e29950421398972d90d802e46f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:42.187267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.187594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.187906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.216990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:42.218418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:42.322785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1024/2059] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:42.333720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:42.335471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:42.439643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff44c0-07aa-41aa-a48d-bcfa84ea54f3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:42.445447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:42.446595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.446880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.447153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.458760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:42.460407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:42.473765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1036/2060] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:42.529527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:42.531073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:42.569597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9828a9-2e1a-4322-ba4c-bba5764b08ce None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:42.579202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:42.580279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.580490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.580838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] PATH_INFO: `/v3/projects/b4235f5e49744b12ba24578e6d9a768f` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.582168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4235f5e49744b12ba24578e6d9a768f)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:42.586291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:42.637355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:42.650961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4235f5e49744b12ba24578e6d9a768f', 'request_id': 'req-f4f35367-2e06-4881-a67f-3fc342858d1b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.666242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4235f5e49744b12ba24578e6d9a768f', 'request_id': 'req-f4f35367-2e06-4881-a67f-3fc342858d1b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.679101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4235f5e49744b12ba24578e6d9a768f', 'request_id': 'req-f4f35367-2e06-4881-a67f-3fc342858d1b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.692653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] The token cache is being invalidate because project b4235f5e49744b12ba24578e6d9a768f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:42.692783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.693432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.695033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1025/2061] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:42 2022] DELETE /identity/v3/projects/b4235f5e49744b12ba24578e6d9a768f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:42.699096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:42.709165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a82972-910c-4065-ac71-661018c7870c service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:42.727140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:42.771548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:42.772446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.772830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.773111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] PATH_INFO: `/v3/users/06473cba03ae4657b8785677da47b4b2` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.774287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06473cba03ae4657b8785677da47b4b2)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:42.776417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:42.819765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:42.823196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:42.847971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f35367-2e06-4881-a67f-3fc342858d1b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:42.855168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06473cba03ae4657b8785677da47b4b2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.858239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:42.870534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:42.870815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:42.871266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] PATH_INFO: `/v3/projects/8e62b419e6cb4352bf7796ab539e415e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:42.874524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e62b419e6cb4352bf7796ab539e415e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:42.876309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06473cba03ae4657b8785677da47b4b2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.876876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:42.890685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06473cba03ae4657b8785677da47b4b2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.891914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06473cba03ae4657b8785677da47b4b2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.901129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06473cba03ae4657b8785677da47b4b2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.909297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1037/2062] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:42 2022] DELETE /identity/v3/users/06473cba03ae4657b8785677da47b4b2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:42.936910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e62b419e6cb4352bf7796ab539e415e', 'request_id': 'req-e51fa950-499c-4ee3-af9b-c8e53408ef79'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.946165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e62b419e6cb4352bf7796ab539e415e', 'request_id': 'req-e51fa950-499c-4ee3-af9b-c8e53408ef79'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.955089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e62b419e6cb4352bf7796ab539e415e', 'request_id': 'req-e51fa950-499c-4ee3-af9b-c8e53408ef79'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.968201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] The token cache is being invalidate because project 8e62b419e6cb4352bf7796ab539e415e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:42.968566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.969470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:42.971322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1026/2063] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:42 2022] DELETE /identity/v3/projects/8e62b419e6cb4352bf7796ab539e415e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:42.975442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:42.977200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:43.097112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d10b9-50bd-4ec2-82e7-cd0573acdc5f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:43.147557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:43.164708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:43.165655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:43.165932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:43.166207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] PATH_INFO: `/v3/users/85573ba8f2b84935933d6699e530844a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:43.167447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85573ba8f2b84935933d6699e530844a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:43.169448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:43.221199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85573ba8f2b84935933d6699e530844a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.229151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85573ba8f2b84935933d6699e530844a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.243405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85573ba8f2b84935933d6699e530844a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.244343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85573ba8f2b84935933d6699e530844a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.254044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85573ba8f2b84935933d6699e530844a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.273767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1038/2064] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:42 2022] DELETE /identity/v3/users/85573ba8f2b84935933d6699e530844a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:43.303653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:43.304207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:43.317066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fa950-499c-4ee3-af9b-c8e53408ef79 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:43.387801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:43.389451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:43.389766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:43.390044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] PATH_INFO: `/v3/projects/421ae83548d744288bdaf3e674365eef` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:43.391269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=421ae83548d744288bdaf3e674365eef)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:43.393316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:43.454119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421ae83548d744288bdaf3e674365eef', 'request_id': 'req-591f9d13-34f1-47ff-b960-9d0d0c5785cd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.463906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:43.466435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421ae83548d744288bdaf3e674365eef', 'request_id': 'req-591f9d13-34f1-47ff-b960-9d0d0c5785cd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.475595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421ae83548d744288bdaf3e674365eef', 'request_id': 'req-591f9d13-34f1-47ff-b960-9d0d0c5785cd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.494207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] The token cache is being invalidate because project 421ae83548d744288bdaf3e674365eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:43.494588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.495392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.497075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1027/2065] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:43 2022] DELETE /identity/v3/projects/421ae83548d744288bdaf3e674365eef => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:43.501320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:43.502805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:43.516446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae9289-6a8d-41d4-98cc-82d4d9aefc7b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:43.586413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:43.588357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:43.588743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:43.589173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] PATH_INFO: `/v3/users/42dcef1696be4640948793ef9cec44b3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:43.590320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dcef1696be4640948793ef9cec44b3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:43.592342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:43.612330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:43.614841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:43.639724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9d13-34f1-47ff-b960-9d0d0c5785cd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:43.646674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:43.649036 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:43.649497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:43.650368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] PATH_INFO: `/v3/projects/cb365e285c914e829a538468004a1b20` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:43.652739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb365e285c914e829a538468004a1b20)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:43.658317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:43.677453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dcef1696be4640948793ef9cec44b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.689294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dcef1696be4640948793ef9cec44b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.698605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:43.705974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dcef1696be4640948793ef9cec44b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.706780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dcef1696be4640948793ef9cec44b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.723109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-518506b7-61e5-4f73-b836-c5fd4716c01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dcef1696be4640948793ef9cec44b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.744582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1039/2066] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:43 2022] DELETE /identity/v3/users/42dcef1696be4640948793ef9cec44b3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:43.755237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb365e285c914e829a538468004a1b20', 'request_id': 'req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.765326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb365e285c914e829a538468004a1b20', 'request_id': 'req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.776911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb365e285c914e829a538468004a1b20', 'request_id': 'req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.813905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] The token cache is being invalidate because project cb365e285c914e829a538468004a1b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:43.814392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.815232 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39b9bb6a-2d74-46ac-bc8a-30c78704a4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:43.817884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1028/2067] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:43 2022] DELETE /identity/v3/projects/cb365e285c914e829a538468004a1b20 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:43.822895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:43.823311 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:43.823488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:43.855110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:43.856553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.034397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1040/2068] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:44.047612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.049016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.049651 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.057806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.065500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.079147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:44.081477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.092977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ce2ef-49e7-46f6-a302-7eea929faba9 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.103828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.107712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.110532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.110914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] PATH_INFO: `/v3/users/2ec32300ef6443f4884de1f1494c7b95` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.112401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec32300ef6443f4884de1f1494c7b95)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.120948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.128397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1029/2069] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:44.135344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.154439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d3afb-1ece-4a8e-8844-a60946558e67 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.173372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.175170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.175676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.176150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.178665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:44.179424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.182005 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.208370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1030/2070] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:44.208650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec32300ef6443f4884de1f1494c7b95'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.210558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.225695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc589-606f-4056-8e7e-0d396ad2cf31 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.226755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec32300ef6443f4884de1f1494c7b95'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.235989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.236825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.237121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.237403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.239176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.242284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.259091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec32300ef6443f4884de1f1494c7b95'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.259905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec32300ef6443f4884de1f1494c7b95'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.282090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6c4c43f4-fa95-4259-8d13-7d0a888e960d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec32300ef6443f4884de1f1494c7b95'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.290236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1031/2071] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:44.290832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1041/2072] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:44 2022] DELETE /identity/v3/users/2ec32300ef6443f4884de1f1494c7b95 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:44.291695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.295681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.295976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.296270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.296551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.339930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:44.341406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.398440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03136b-2848-4703-b14a-661ab72c5654 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.439370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:44.447126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:44.477187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1042/2073] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:44.478491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.480649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.498557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8a65-2960-4ea8-973f-741e229b0e40 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.507458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.509059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.509509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.509943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] PATH_INFO: `/v3/projects/b5e9613807274d9ca20215810a1edb27` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.512381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e9613807274d9ca20215810a1edb27)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.515565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.523020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.524429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.524746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.525278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.526151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.530199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.579348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1032/2074] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:44.579348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.582164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.617034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e9613807274d9ca20215810a1edb27', 'request_id': 'req-f791e66c-6550-4842-8e99-7f7a983bfc5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.627906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e9613807274d9ca20215810a1edb27', 'request_id': 'req-f791e66c-6550-4842-8e99-7f7a983bfc5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.637193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e9613807274d9ca20215810a1edb27', 'request_id': 'req-f791e66c-6550-4842-8e99-7f7a983bfc5a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.654393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] The token cache is being invalidate because project b5e9613807274d9ca20215810a1edb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:44.654694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.655339 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:44.657165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1043/2075] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:44 2022] DELETE /identity/v3/projects/b5e9613807274d9ca20215810a1edb27 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:44.657718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.659093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.660557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd010-b46c-45e4-bc17-d864b8729f29 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.723262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.724544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.724870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.725153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.728234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.740986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e66c-6550-4842-8e99-7f7a983bfc5a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.745876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.748179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.748630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3d1d1-23c8-42c9-8826-c51b08835c07 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.749056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.749415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.749765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.750582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.752324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.759721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1033/2076] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:44.760955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.761248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.761946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.768746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1044/2077] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:44.769676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.779997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2135-3ca3-4ad6-951f-86e8a3ba202a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.784503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:44.785107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf90b-e433-41ce-9882-54732e534939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.785831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.785937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf90b-e433-41ce-9882-54732e534939 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.786223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf90b-e433-41ce-9882-54732e534939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.786571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf90b-e433-41ce-9882-54732e534939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.787380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf90b-e433-41ce-9882-54732e534939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.789129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf90b-e433-41ce-9882-54732e534939 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.794287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1034/2078] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:44.802987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1045/2079] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:44.804463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.806406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.806762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.807113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.816154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c150101-4c6d-44c6-bf39-05478ffcde29 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.822308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afa01-ede6-414e-adeb-0302f2034157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.823410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afa01-ede6-414e-adeb-0302f2034157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.823918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afa01-ede6-414e-adeb-0302f2034157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.824248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afa01-ede6-414e-adeb-0302f2034157 admin admin] PATH_INFO: `/v3/projects/2da45b4158c14f1dbd71d3b7e4e62e8e/users/92ab69ad3d3f4fb1a56b924d5081e7d6/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.831674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:44.832915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.844274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1046/2080] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:44.844467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afa01-ede6-414e-adeb-0302f2034157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da45b4158c14f1dbd71d3b7e4e62e8e, user_id=92ab69ad3d3f4fb1a56b924d5081e7d6, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.844467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afa01-ede6-414e-adeb-0302f2034157 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.845563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.856816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc3f07-652b-4c4c-8199-a15f1f07956b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.859798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1035/2081] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:44 2022] PUT /identity/v3/projects/2da45b4158c14f1dbd71d3b7e4e62e8e/users/92ab69ad3d3f4fb1a56b924d5081e7d6/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:44.870925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.871643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.872084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.906034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] MFA Rules not processed for user `92ab69ad3d3f4fb1a56b924d5081e7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:44.907350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:44.928903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.930349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.930647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.930925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.931984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:44.932468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.934204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:44.936642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:44.959594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1047/2082] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:44.962207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:44.970705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:44.973445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109433c-0ec7-4383-9f75-1798c2826b72 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:44.978862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:44.979585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:44.979874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:44.980916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:44.981776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:44.985261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.024336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1036/2083] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:45.036058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.037542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:45.041584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1048/2084] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:44 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:45.042908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.112292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb8cf-cb49-4585-ab55-ec460a117b4a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.132792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7b95b-26f1-4c31-9de1-6c8e5cbbdfcb admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.143531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.144783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.144783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.144993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.146841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.149171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.185442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1049/2085] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:45 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:45.189745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.205517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.206265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.206930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.207281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.216999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096409-d892-47e2-bd19-993a49516ccc admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.225591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.226633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.226936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.227771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.228622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.233443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.255450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1050/2086] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:45.258081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.280233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d83a4-c13a-494b-a6fb-345f6ec33754 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.306439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7972f7-329b-4e6c-86c3-95af4836a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.307208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7972f7-329b-4e6c-86c3-95af4836a444 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.307585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7972f7-329b-4e6c-86c3-95af4836a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.307934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7972f7-329b-4e6c-86c3-95af4836a444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.308848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7972f7-329b-4e6c-86c3-95af4836a444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.310652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7972f7-329b-4e6c-86c3-95af4836a444 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.313841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.315629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.328170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1037/2087] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:45.335877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1051/2088] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:45.336789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.349872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a965-722d-4989-a85c-a46384669e0c service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.364136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.373714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.374931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.377781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] PATH_INFO: `/v3/projects/5221a135dcfa4926a06712f2083fcc7d/users/91e67292eb0e4db183962dfe3719d2df/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.414657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5221a135dcfa4926a06712f2083fcc7d, user_id=91e67292eb0e4db183962dfe3719d2df, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.418306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.446238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1038/2089] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:45 2022] PUT /identity/v3/projects/5221a135dcfa4926a06712f2083fcc7d/users/91e67292eb0e4db183962dfe3719d2df/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:45.458302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.458515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.458783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.535161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] MFA Rules not processed for user `91e67292eb0e4db183962dfe3719d2df`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:45.536426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:45.563184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.566581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:45.677206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:45.698890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1052/2090] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:45.715903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:45.739676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:45.819425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e361-d27e-4b50-8a15-c6115c20034e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.839623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.840534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.840847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.841127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] PATH_INFO: `/v3/projects/dc9662d4896a4797ba37e4625dc7bb9c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.842895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9662d4896a4797ba37e4625dc7bb9c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.845171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.846748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:45.883785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45404f88-c7d0-416e-8dc7-6ba7c811d5cc None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:45.890983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:45.891578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:45.891970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:45.892198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:45.903145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:45.904845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:45.929772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1053/2091] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:45.937527 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9662d4896a4797ba37e4625dc7bb9c', 'request_id': 'req-bb17ef62-9628-4021-b76e-98741b2b3357'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:45.947512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9662d4896a4797ba37e4625dc7bb9c', 'request_id': 'req-bb17ef62-9628-4021-b76e-98741b2b3357'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:45.967646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9662d4896a4797ba37e4625dc7bb9c', 'request_id': 'req-bb17ef62-9628-4021-b76e-98741b2b3357'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:45.983961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] The token cache is being invalidate because project dc9662d4896a4797ba37e4625dc7bb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:45.985085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:45.985938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:45.988456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1039/2092] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:45 2022] DELETE /identity/v3/projects/dc9662d4896a4797ba37e4625dc7bb9c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:45.991869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:46.008558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63405-3b96-4eb1-9885-7ff29696717a service glance] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:46.087582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:46.088540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:46.088859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:46.089140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] PATH_INFO: `/v3/users/c1edbd835d8740609e0a33a7da9ee415` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:46.090548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1edbd835d8740609e0a33a7da9ee415)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:46.092625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:46.151110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1edbd835d8740609e0a33a7da9ee415'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.159058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1edbd835d8740609e0a33a7da9ee415'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.171167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1edbd835d8740609e0a33a7da9ee415'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.171920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1edbd835d8740609e0a33a7da9ee415'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.180552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-018ec33f-3e71-4563-ad73-7e8e496f146e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1edbd835d8740609e0a33a7da9ee415'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.187230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1054/2093] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:45 2022] DELETE /identity/v3/users/c1edbd835d8740609e0a33a7da9ee415 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:46.539037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:46.541391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:46.572902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ef62-9628-4021-b76e-98741b2b3357 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:46.636300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:46.637222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:46.637514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:46.637798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] PATH_INFO: `/v3/projects/c533506690684bd1801666e74ac5bc13` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:46.639455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c533506690684bd1801666e74ac5bc13)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:46.641891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:46.715086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c533506690684bd1801666e74ac5bc13', 'request_id': 'req-439db6e1-14e6-49b0-a3b4-fab3335061f0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.725627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c533506690684bd1801666e74ac5bc13', 'request_id': 'req-439db6e1-14e6-49b0-a3b4-fab3335061f0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.727841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:46.745508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c533506690684bd1801666e74ac5bc13', 'request_id': 'req-439db6e1-14e6-49b0-a3b4-fab3335061f0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.761411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] The token cache is being invalidate because project c533506690684bd1801666e74ac5bc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:46.761707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.762364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-439db6e1-14e6-49b0-a3b4-fab3335061f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:46.764636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1040/2094] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:46 2022] DELETE /identity/v3/projects/c533506690684bd1801666e74ac5bc13 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:46.770200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:46.771931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:46.772219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:46.791221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:46.792428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:46.859405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:46.885018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1055/2095] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:46.890248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:46.899772 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:46.899772 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:46.925634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:46.926850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:46.952490 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1041/2096] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:46.955882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:46.970081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38464-17cc-4390-9b6b-cd192c1f8aae None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:46.976189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:46.993425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:46.993901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:46.997964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:46.999526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:47.001351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.006421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.037584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1056/2097] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:47.041919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.053817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617142-8c96-48db-9aea-fbb550a07a1f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.059346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.060138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.060561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.060952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.061726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.063706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.098412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1042/2098] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:47 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:47.104518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.117516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e889c-12cf-48a4-b604-bbb4d616096d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.225958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.226607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.226904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.227443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.228302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.231163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.256867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1057/2099] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:47 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:47.261106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.272652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0d27-20df-4217-9e88-a956c1b9ff3b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.283767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.284748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.285100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.285453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.286300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.288256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.301448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1043/2100] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:47.305380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.315601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bc285-e666-4bc4-80d5-6d7c5229f5de admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.320271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654815d6-f7ba-4651-b6e4-2e8179e8fcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.320971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654815d6-f7ba-4651-b6e4-2e8179e8fcef admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.321237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654815d6-f7ba-4651-b6e4-2e8179e8fcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.321510 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654815d6-f7ba-4651-b6e4-2e8179e8fcef admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.322280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654815d6-f7ba-4651-b6e4-2e8179e8fcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.323905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654815d6-f7ba-4651-b6e4-2e8179e8fcef admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.335623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1058/2101] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:47.339986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.350174 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce44dc-ba82-414e-95fc-c7df35bed099 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.355073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.355920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.356201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.356467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] PATH_INFO: `/v3/projects/41772584034d4927a7b0f7dae30b3b51/users/4373648fc51b4391910cfbe88267914b/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.372143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41772584034d4927a7b0f7dae30b3b51, user_id=4373648fc51b4391910cfbe88267914b, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.374948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.390556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1044/2102] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:47 2022] PUT /identity/v3/projects/41772584034d4927a7b0f7dae30b3b51/users/4373648fc51b4391910cfbe88267914b/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:47.401644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.401743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.401991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.435465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] MFA Rules not processed for user `4373648fc51b4391910cfbe88267914b`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:47.436743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:47.515977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1059/2103] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:47.520322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.582729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470a0b9-aa38-42c9-aceb-233044676f75 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.587771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.588435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.588756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.589031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.589702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.591679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.626044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1045/2104] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:47 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:47.627834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.645925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb28e93-7b36-478a-aa0f-fac286dc02de None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.697732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:47.712268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.713019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.713374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.713683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.714425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.716466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.738511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1060/2105] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:47 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:47.742639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.753618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2976d0-4fb9-4ccc-993d-9e0504942bf4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.759281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.759978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.760324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.760742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.761352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.763062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.775502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1046/2106] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:47.779934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.790710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3c7d-c8b2-4cbe-82a2-728103ae09b6 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.796487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.797463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.797743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.798210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] PATH_INFO: `/v3/projects/7c1a10ad066444898937b448d4baa97e/users/7f57e2287dc3474db2de9bf2b2f1b6ca/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.814936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1a10ad066444898937b448d4baa97e, user_id=7f57e2287dc3474db2de9bf2b2f1b6ca, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.817853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.836310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1061/2107] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:47 2022] PUT /identity/v3/projects/7c1a10ad066444898937b448d4baa97e/users/7f57e2287dc3474db2de9bf2b2f1b6ca/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:47.837595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.849061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3b3c-71cd-4b0e-8392-a30cc5224fb8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.902289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:47.914159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a63f6-9785-4ae3-9db0-a1dfc2713d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.915127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a63f6-9785-4ae3-9db0-a1dfc2713d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.915538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a63f6-9785-4ae3-9db0-a1dfc2713d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.916056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a63f6-9785-4ae3-9db0-a1dfc2713d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.916861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a63f6-9785-4ae3-9db0-a1dfc2713d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.918745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a63f6-9785-4ae3-9db0-a1dfc2713d35 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.933322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1047/2108] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:47.939450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:47.956365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d21a-c1c1-4cb7-b178-993c11ab4cb2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:47.962182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:47.963124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.963416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.963689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] PATH_INFO: `/v3/projects/7c1a10ad066444898937b448d4baa97e/users/7f57e2287dc3474db2de9bf2b2f1b6ca/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:47.965906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1a10ad066444898937b448d4baa97e, user_id=7f57e2287dc3474db2de9bf2b2f1b6ca, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:47.968697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:47.980042 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1062/2109] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:47 2022] PUT /identity/v3/projects/7c1a10ad066444898937b448d4baa97e/users/7f57e2287dc3474db2de9bf2b2f1b6ca/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:47.991355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:47.991631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:47.991911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:48.021250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] MFA Rules not processed for user `7f57e2287dc3474db2de9bf2b2f1b6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:48.022560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:48.106130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1048/2110] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:48.134741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:48.136500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:48.215434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477ebd-8ae6-4734-b97b-0bfa4fb52b42 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:48.220786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:48.221817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:48.222092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:48.222549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:48.295991 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:48.297784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:48.312858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1063/2111] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:53.485149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:53.486702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:53.572636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bec3a-7a4a-4fd0-94e6-edff48ac810f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:53.579297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:53.580459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:53.581284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:53.581620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] PATH_INFO: `/v3/users/0429f5d2715a4487a39281edbd941fbd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:53.583200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0429f5d2715a4487a39281edbd941fbd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:53.585310 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:53.675014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0429f5d2715a4487a39281edbd941fbd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:53.676488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0429f5d2715a4487a39281edbd941fbd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:53.701090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0429f5d2715a4487a39281edbd941fbd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:53.711936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0429f5d2715a4487a39281edbd941fbd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:53.713013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-130d0bf9-7219-416e-a953-4f1b3d9a2aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0429f5d2715a4487a39281edbd941fbd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:53.718108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:53.729419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1049/2112] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:53 2022] DELETE /identity/v3/users/0429f5d2715a4487a39281edbd941fbd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:53.909459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:53.933673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4047b-2518-4a16-a019-bbec8c006bd6 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.010338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:54.033969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.035088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.035360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.035657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] PATH_INFO: `/v3/projects/9dd50da000f94eeca1c4f6ab9867d4d6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.041527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd50da000f94eeca1c4f6ab9867d4d6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.041527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.115029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd50da000f94eeca1c4f6ab9867d4d6', 'request_id': 'req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:54.160718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd50da000f94eeca1c4f6ab9867d4d6', 'request_id': 'req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:54.177233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd50da000f94eeca1c4f6ab9867d4d6', 'request_id': 'req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:54.207305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] The token cache is being invalidate because project 9dd50da000f94eeca1c4f6ab9867d4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:54.207613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:54.208446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9dca7fdd-9972-4d16-8ae0-8b6bf2ea5ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:54.214505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1064/2113] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:53 2022] DELETE /identity/v3/projects/9dd50da000f94eeca1c4f6ab9867d4d6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:54.219800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.220146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.220381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.261532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:54.262866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:54.350219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1050/2114] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:54.358254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.358548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.358830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.380824 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:54.382102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:54.391269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1065/2115] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:54.397919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.408033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531ca1-ea09-48e7-9c39-e35022ecc1a1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.413187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.414069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.414267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.414447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.417409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:54.417801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.419589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.432637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1051/2116] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:54.436485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.445906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759f5b-0a1f-4405-90df-57418583b4c9 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.452115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.452832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.453125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.453406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.454093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.456400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.483097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1066/2117] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:54.487956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.498365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729ccf7-c14a-4339-a15f-5730f8ea1f98 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.573108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.573108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.573108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.573108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.573445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.573445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.593678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1052/2118] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:54.594836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.605321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fbfea-8e6f-4bc7-b675-af9a64b117a9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.610814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.611491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.611798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.612056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.612835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.614607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.625509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1067/2119] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:54.629763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.640321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea62665-5283-48e6-a3db-cc32341e2fb6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.648788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3029-388c-4d4c-8919-320ec23eacc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.648788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3029-388c-4d4c-8919-320ec23eacc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.648788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3029-388c-4d4c-8919-320ec23eacc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.648788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3029-388c-4d4c-8919-320ec23eacc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.649233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd3029-388c-4d4c-8919-320ec23eacc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.650823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd3029-388c-4d4c-8919-320ec23eacc2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.665934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1053/2120] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:54.667174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.683852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a2fc8-8eba-4f75-8f65-03e92b361dc8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.688591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.689505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.689783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.690053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] PATH_INFO: `/v3/projects/df479df5b04b4ba7a9bdb15ee44eb250/users/df8950108a3a4be483620c18b6ed6aa4/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.714115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df479df5b04b4ba7a9bdb15ee44eb250, user_id=df8950108a3a4be483620c18b6ed6aa4, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.717022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.732717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1068/2121] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:54 2022] PUT /identity/v3/projects/df479df5b04b4ba7a9bdb15ee44eb250/users/df8950108a3a4be483620c18b6ed6aa4/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:54.746831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.747131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.747413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.780539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] MFA Rules not processed for user `df8950108a3a4be483620c18b6ed6aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:54.781824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:54.842664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:54.863534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.865327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:54.882153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1054/2122] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:54.887610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:54.928105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097907fd-d830-47c5-9e4a-2ac518cec79f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.932230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.933090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.933493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.933792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.936084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:54.956961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c70662-db50-4f12-8e0d-829a4e5ff980 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:54.962072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:54.962439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:54.962724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:54.962998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:54.963693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:54.965679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:54.970367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:54.993277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1055/2123] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:54.997308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.019803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.021673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.033103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1069/2124] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:55.067489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8228-6e43-4604-8a69-2a44b60e9c2c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.073027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.073690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.073979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.074280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.075022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.077033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.096635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1056/2125] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:54 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:55.100737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.112514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db64b-8f8f-4ee0-8f45-63167fc95614 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.118270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.119147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.119490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.119708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.120449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.122333 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.132812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1070/2126] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:55.137128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.147727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382e2d-40d9-4938-b930-fcc585577b39 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.153200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.154160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.154506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.154820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] PATH_INFO: `/v3/projects/d1a528a66ca64a2288c443180649be7f/users/2e183d034d6a4ae5a8f0d8910421f7e9/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.171158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a528a66ca64a2288c443180649be7f, user_id=2e183d034d6a4ae5a8f0d8910421f7e9, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.173964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.197818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1057/2127] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:55 2022] PUT /identity/v3/projects/d1a528a66ca64a2288c443180649be7f/users/2e183d034d6a4ae5a8f0d8910421f7e9/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:55.204128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.215019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c73b3-0f3f-4fec-9f15-a3b77ff65983 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.279625 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e7f42-4dd9-4a6c-99f1-cd5a59534094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.280326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e7f42-4dd9-4a6c-99f1-cd5a59534094 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.280682 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e7f42-4dd9-4a6c-99f1-cd5a59534094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.281012 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e7f42-4dd9-4a6c-99f1-cd5a59534094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.284080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e7f42-4dd9-4a6c-99f1-cd5a59534094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.285754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e7f42-4dd9-4a6c-99f1-cd5a59534094 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.305240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1071/2128] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:55.306619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.324312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934459-e62d-40f3-b999-d5b002895649 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.332842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.333773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.334202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.334492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] PATH_INFO: `/v3/projects/d1a528a66ca64a2288c443180649be7f/users/2e183d034d6a4ae5a8f0d8910421f7e9/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.336488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a528a66ca64a2288c443180649be7f, user_id=2e183d034d6a4ae5a8f0d8910421f7e9, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.339326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.360880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1058/2129] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:55 2022] PUT /identity/v3/projects/d1a528a66ca64a2288c443180649be7f/users/2e183d034d6a4ae5a8f0d8910421f7e9/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:55.362947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.363240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.363522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.391624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] MFA Rules not processed for user `2e183d034d6a4ae5a8f0d8910421f7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:55.392903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:55.475586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1072/2130] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:55.493789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.497387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:55.541461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:55.573776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99a5f7-24a0-4fe4-ab2f-d3c9af789e0a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.577984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.578657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.578942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.579225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.588827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.590289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.600093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1059/2131] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:55 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:55.849911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.860633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d618-6d28-40a1-b14b-65e9138809bb None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.863066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:55.863282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fbf12-8cae-4d03-8896-b4aeea1419e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.863945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fbf12-8cae-4d03-8896-b4aeea1419e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.864229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fbf12-8cae-4d03-8896-b4aeea1419e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.864503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fbf12-8cae-4d03-8896-b4aeea1419e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.864631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:55.906696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:55.933330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fbf12-8cae-4d03-8896-b4aeea1419e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.934966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fbf12-8cae-4d03-8896-b4aeea1419e1 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.935399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad26ea7-37a6-40ce-a8c5-199dbdee428a service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:55.940210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:55.941200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:55.941546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:55.941890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] PATH_INFO: `/v3/users/d34308e611254e51b3d9eaeafcba5ea0` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:55.943148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34308e611254e51b3d9eaeafcba5ea0)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:55.945315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:55.946017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1073/2132] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:55 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:56.007926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34308e611254e51b3d9eaeafcba5ea0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.008873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34308e611254e51b3d9eaeafcba5ea0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.028917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34308e611254e51b3d9eaeafcba5ea0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.038556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34308e611254e51b3d9eaeafcba5ea0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.039714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34308e611254e51b3d9eaeafcba5ea0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.059234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1060/2133] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:55 2022] DELETE /identity/v3/users/d34308e611254e51b3d9eaeafcba5ea0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:56.064589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:56.064827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:56.065438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:56.091951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:56.093328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:56.155795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1074/2134] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:56.165561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:56.167028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:56.221488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:56.225727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d004-f0d4-4fec-af9d-f3b01cb06dcc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:56.230616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:56.231671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:56.232198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:56.232541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:56.242020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:56.243481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:56.252930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1061/2135] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:56.555437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:56.557257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:56.571482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72d7bf-4549-4fab-9ef7-b15512b9de93 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:56.577234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:56.578214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:56.578561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:56.578931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] PATH_INFO: `/v3/projects/f2b3f4586f574c5db015c6e6bc826529` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:56.580688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b3f4586f574c5db015c6e6bc826529)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:56.582919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:56.672032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b3f4586f574c5db015c6e6bc826529', 'request_id': 'req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.681984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b3f4586f574c5db015c6e6bc826529', 'request_id': 'req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.689149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b3f4586f574c5db015c6e6bc826529', 'request_id': 'req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.701152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] The token cache is being invalidate because project f2b3f4586f574c5db015c6e6bc826529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:56.701500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.702210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.703975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1075/2136] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:56 2022] DELETE /identity/v3/projects/f2b3f4586f574c5db015c6e6bc826529 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:56.707866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:56.718350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04876-d871-433d-ab92-26ed01bcede7 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:56.774027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:56.774918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:56.775207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:56.775485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] PATH_INFO: `/v3/users/def4cb2460a743e3b018d3647d322c27` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:56.776702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def4cb2460a743e3b018d3647d322c27)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:56.778709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:56.830791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def4cb2460a743e3b018d3647d322c27'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.831461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def4cb2460a743e3b018d3647d322c27'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.842989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def4cb2460a743e3b018d3647d322c27'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.857682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def4cb2460a743e3b018d3647d322c27'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.857682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-76e05a49-fe02-4982-a5eb-cf9fa17ea1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def4cb2460a743e3b018d3647d322c27'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:56.870976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1062/2137] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:56 2022] DELETE /identity/v3/users/def4cb2460a743e3b018d3647d322c27 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:57.197932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.199437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:57.214411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221ddc6-e17c-48d1-80ba-09b5fdc9fe25 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.280515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.281592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.282069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.282775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] PATH_INFO: `/v3/projects/af97745cf158416bb69effcbac68359e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.284134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=af97745cf158416bb69effcbac68359e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.286200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.291752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:57.351670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af97745cf158416bb69effcbac68359e', 'request_id': 'req-cf3bd34d-9b41-4661-b802-b53e807912ce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:57.359696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af97745cf158416bb69effcbac68359e', 'request_id': 'req-cf3bd34d-9b41-4661-b802-b53e807912ce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:57.366402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af97745cf158416bb69effcbac68359e', 'request_id': 'req-cf3bd34d-9b41-4661-b802-b53e807912ce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:57.377248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] The token cache is being invalidate because project af97745cf158416bb69effcbac68359e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:57.377498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:57.378263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cf3bd34d-9b41-4661-b802-b53e807912ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:57.380251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1076/2138] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:57 2022] DELETE /identity/v3/projects/af97745cf158416bb69effcbac68359e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:57.386851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.387078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.387444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.410834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:57.412045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:57.478621 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1063/2139] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:57.487151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.487507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.487809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.509867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:57.511089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:57.521597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1077/2140] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:57.526334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.536334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b7e8-7f49-43e1-ba46-11ad87299360 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.541691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.542394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.542680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.542954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.543682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:57.543992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.545784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.552726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:57.559074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1064/2141] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:57.563932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.574997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4311-18fb-49ec-adc9-6aad3dc528f0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.580167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.580879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.581194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.581470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.582160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.584100 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.616257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1078/2142] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:57 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:57.617427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.627866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f722e-d9aa-4cb3-b5f4-ee377567db16 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.694457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.695166 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.695456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.695735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.696521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.698433 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.720816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1065/2143] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:57 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:57.724871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.735424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eee76-b022-4ec2-87eb-a1d23f7bb248 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.741696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.742457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.742815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.743091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.743834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.745511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.758371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1079/2144] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:57.762720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.779132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8513a0-ec8a-4b40-89f1-191f6d74e826 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.792100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc1f8-bb01-49d5-9659-2bca14182048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.792941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc1f8-bb01-49d5-9659-2bca14182048 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.799873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc1f8-bb01-49d5-9659-2bca14182048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.800483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc1f8-bb01-49d5-9659-2bca14182048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.802274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc1f8-bb01-49d5-9659-2bca14182048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.804733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc1f8-bb01-49d5-9659-2bca14182048 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.823182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1066/2145] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:57.824657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:57.837857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe13b-d9bd-411c-8bd9-4cd83f7bd204 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:57.842691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:57.843585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.843866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.844142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] PATH_INFO: `/v3/projects/cec3facfcffa44b8b3ce6971860ae957/users/4f6d2f3b90154af1abd3be4803883d15/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.859840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec3facfcffa44b8b3ce6971860ae957, user_id=4f6d2f3b90154af1abd3be4803883d15, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:57.862582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:57.877439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1080/2146] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:57 2022] PUT /identity/v3/projects/cec3facfcffa44b8b3ce6971860ae957/users/4f6d2f3b90154af1abd3be4803883d15/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:57.887800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:57.888032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:57.888820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:57.919513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] MFA Rules not processed for user `4f6d2f3b90154af1abd3be4803883d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:57.920851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:57.993116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1067/2147] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:57.998394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.070260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c1b8c-c821-4f38-94e4-f4c0b71e8eb8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.075250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.075923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.076211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.076491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.077230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.079260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.105879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1081/2148] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:57 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:58.110656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.123614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee09d92-7364-407f-a838-43baeca535bf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.193424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.194146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.194442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.194952 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.195866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.198181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.215288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:58.216338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.218527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.232666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1068/2149] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:58 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:58.233141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30fdd-b6b9-4888-ac8a-1aab9bac06f3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.234494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.237766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.238706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.238969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.239249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] PATH_INFO: `/v3/users/92ab69ad3d3f4fb1a56b924d5081e7d6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.240455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ab69ad3d3f4fb1a56b924d5081e7d6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.242443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.244319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1626c1-03b7-4f6f-92b0-1892a55536d9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.248556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:58.249513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.250247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.250537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.250850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.251576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.253222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.264635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1069/2150] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:58.268709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.280552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf3bc-c4b6-4ae0-ab64-e17849a23a8a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.286726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.287662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.287953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.288239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] PATH_INFO: `/v3/projects/2eb24cae483a468a83cfaeadd85e3256/users/7facb8cf4e7a4a389565b1a8bc0b1174/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.303446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ab69ad3d3f4fb1a56b924d5081e7d6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:58.304872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb24cae483a468a83cfaeadd85e3256, user_id=7facb8cf4e7a4a389565b1a8bc0b1174, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.307633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.310888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ab69ad3d3f4fb1a56b924d5081e7d6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:58.325233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1070/2151] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:58 2022] PUT /identity/v3/projects/2eb24cae483a468a83cfaeadd85e3256/users/7facb8cf4e7a4a389565b1a8bc0b1174/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:58.326997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ab69ad3d3f4fb1a56b924d5081e7d6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:58.327739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ab69ad3d3f4fb1a56b924d5081e7d6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:58.329217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.340123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8af8fe5d-2a3a-4bb8-b42c-73998c227649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ab69ad3d3f4fb1a56b924d5081e7d6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:58.347325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1082/2152] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:18:58 2022] DELETE /identity/v3/users/92ab69ad3d3f4fb1a56b924d5081e7d6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:58.351536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.351834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.352124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.370570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:58.371796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.410389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c493-2ce5-406b-8ccb-3cc4c46749bb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.447126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1083/2153] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:58.459484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.461254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.473766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.474677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.474968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.475485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.476229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.478018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.490152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1071/2154] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:18:58.494831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.497489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.516412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc94f-9086-4ae8-9b84-82bf897e2ceb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.521268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054b6c-872b-4f53-8e5f-b0fb77ba6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.522170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054b6c-872b-4f53-8e5f-b0fb77ba6a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.522893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054b6c-872b-4f53-8e5f-b0fb77ba6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.522893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054b6c-872b-4f53-8e5f-b0fb77ba6a49 admin admin] PATH_INFO: `/v3/projects/2eb24cae483a468a83cfaeadd85e3256/users/7facb8cf4e7a4a389565b1a8bc0b1174/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.524881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054b6c-872b-4f53-8e5f-b0fb77ba6a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb24cae483a468a83cfaeadd85e3256, user_id=7facb8cf4e7a4a389565b1a8bc0b1174, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.527586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054b6c-872b-4f53-8e5f-b0fb77ba6a49 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.529587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cff7aa-f05b-4b39-ad9d-a685dca4a4ec None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.533858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.534705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.535170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.535536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.540784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1072/2155] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:58 2022] PUT /identity/v3/projects/2eb24cae483a468a83cfaeadd85e3256/users/7facb8cf4e7a4a389565b1a8bc0b1174/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:18:58.553048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.553428 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.553782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.556118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.558240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.573278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1084/2156] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:18:58.585788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] MFA Rules not processed for user `7facb8cf4e7a4a389565b1a8bc0b1174`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:58.587155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.640161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:58.679761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1073/2157] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:58.695343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.697068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.742226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:58.771345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f7ce6-5b96-4653-96fd-1c9b38e4c49e service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:58.851318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:58.852020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:58.852273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:58.852549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:58.854978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.917215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:58.919583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:58.932067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:58.933815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509019b-8140-421e-93e3-e8e9a1e4979f service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:58.958211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1085/2158] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:18:59.017690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170170c-b86b-48e4-b9af-d54917af8d90 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.022700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.023968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.024312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.024876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] PATH_INFO: `/v3/projects/2da45b4158c14f1dbd71d3b7e4e62e8e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.026132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da45b4158c14f1dbd71d3b7e4e62e8e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.028105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.090132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da45b4158c14f1dbd71d3b7e4e62e8e', 'request_id': 'req-325f6673-b744-4b5c-b8d5-e176f7a59547'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:59.100905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da45b4158c14f1dbd71d3b7e4e62e8e', 'request_id': 'req-325f6673-b744-4b5c-b8d5-e176f7a59547'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:59.111723 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da45b4158c14f1dbd71d3b7e4e62e8e', 'request_id': 'req-325f6673-b744-4b5c-b8d5-e176f7a59547'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:59.136257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] The token cache is being invalidate because project 2da45b4158c14f1dbd71d3b7e4e62e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:18:59.136702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:59.141054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-325f6673-b744-4b5c-b8d5-e176f7a59547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:18:59.143064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1074/2159] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:18:58 2022] DELETE /identity/v3/projects/2da45b4158c14f1dbd71d3b7e4e62e8e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:59.147715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.148010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.148293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.167302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:59.168581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:59.261455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1086/2160] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:59.263681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.263978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.264263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.286088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:59.287327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:59.299886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1075/2161] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:18:59.304024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.316994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50140b21-9523-40e8-9220-a78a6687e1c1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.321963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.322721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.323116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.323463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.324255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:18:59.324701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.326664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.343848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1087/2162] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:18:59.348173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.358176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1dc9e-0fd5-4268-ac7d-0065558abac6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.362965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.363634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.363919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.364194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.364932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.366927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.396637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1076/2163] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:18:59 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:18:59.399392 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.411572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d1d5-59cf-4491-a831-2035eaceef8d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.437146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:59.472206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.472848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.473137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.473412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.474110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.476071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.498875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1088/2164] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:18:59 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:18:59.503596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.515317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d893e-4fd4-4bb5-bb5a-b81866a24ffe admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.522695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.523390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.523745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.524028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.524804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.526450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.538333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1077/2165] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:59.542675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.554875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac225-12dc-4931-99ce-8e18313633d0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.565975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652f87d-dd52-412e-bf3c-92c8f1043526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.566663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f87d-dd52-412e-bf3c-92c8f1043526 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.566943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f87d-dd52-412e-bf3c-92c8f1043526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.567214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f87d-dd52-412e-bf3c-92c8f1043526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.567959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652f87d-dd52-412e-bf3c-92c8f1043526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.569724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652f87d-dd52-412e-bf3c-92c8f1043526 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.581673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1089/2166] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:18:59.588261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.600136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba97c-5449-4c2c-8510-0e275ce26e2c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.605876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.606812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.607124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.607407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] PATH_INFO: `/v3/projects/df984bae4f4e4d01ac06870bee8a73bf/users/dc9c9dd337834dea821cc4ea6ecc10a6/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.624346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df984bae4f4e4d01ac06870bee8a73bf, user_id=dc9c9dd337834dea821cc4ea6ecc10a6, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.627961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.642886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1078/2167] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:18:59 2022] PUT /identity/v3/projects/df984bae4f4e4d01ac06870bee8a73bf/users/dc9c9dd337834dea821cc4ea6ecc10a6/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:18:59.649445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.649866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.650302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.670046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:18:59.671519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:59.741377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1090/2168] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:18:59.752518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:18:59.754554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:18:59.760531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:59.819982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bf529-501c-41cd-8452-fd5189acbf03 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:18:59.824113 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ce879-0183-483a-a0fd-33e8adf5f279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:18:59.824785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ce879-0183-483a-a0fd-33e8adf5f279 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:18:59.825068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ce879-0183-483a-a0fd-33e8adf5f279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:18:59.825350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ce879-0183-483a-a0fd-33e8adf5f279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:18:59.834856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ce879-0183-483a-a0fd-33e8adf5f279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:18:59.836318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ce879-0183-483a-a0fd-33e8adf5f279 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:18:59.847764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1079/2169] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:00.020488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:00.022076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:00.035417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc2a4b-3c07-489d-8737-25fa68040d5c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:00.040492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:00.041550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:00.041809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:00.042068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] PATH_INFO: `/v3/users/4373648fc51b4391910cfbe88267914b` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:00.043640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4373648fc51b4391910cfbe88267914b)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:00.046202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:00.124931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4373648fc51b4391910cfbe88267914b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:00.135240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4373648fc51b4391910cfbe88267914b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:00.154646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4373648fc51b4391910cfbe88267914b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:00.156319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4373648fc51b4391910cfbe88267914b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:00.172014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4373648fc51b4391910cfbe88267914b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:00.186812 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1091/2170] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:00 2022] DELETE /identity/v3/users/4373648fc51b4391910cfbe88267914b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:00.191544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:00.191967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:00.192239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:00.221122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:00.222498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:00.339669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1080/2171] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:00.359015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:00.360756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:00.407295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:00.504655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f38e9-e70b-4bd5-b486-bbf0dbc31985 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:00.515149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:00.515990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:00.516282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:00.516562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:00.538989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:00.541008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:00.556274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1092/2172] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:00.955017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:00.956687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:00.972878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d24a-40cc-4b26-a0d6-9b362bbab778 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:00.979096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:00.980654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:00.980654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:00.980654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] PATH_INFO: `/v3/projects/41772584034d4927a7b0f7dae30b3b51` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:00.982459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41772584034d4927a7b0f7dae30b3b51)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:00.986117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:01.052173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41772584034d4927a7b0f7dae30b3b51', 'request_id': 'req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.059481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41772584034d4927a7b0f7dae30b3b51', 'request_id': 'req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.069563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41772584034d4927a7b0f7dae30b3b51', 'request_id': 'req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.085794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] The token cache is being invalidate because project 41772584034d4927a7b0f7dae30b3b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:01.086375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.087324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.089442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1081/2173] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:00 2022] DELETE /identity/v3/projects/41772584034d4927a7b0f7dae30b3b51 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:01.093298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:01.104843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20c445-500d-41d0-bf91-22cc64df6c73 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:01.194098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:01.195052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:01.195338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:01.195619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] PATH_INFO: `/v3/users/7f57e2287dc3474db2de9bf2b2f1b6ca` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:01.196868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f57e2287dc3474db2de9bf2b2f1b6ca)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:01.198825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:01.251884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f57e2287dc3474db2de9bf2b2f1b6ca'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.261665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f57e2287dc3474db2de9bf2b2f1b6ca'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.278157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f57e2287dc3474db2de9bf2b2f1b6ca'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.278484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f57e2287dc3474db2de9bf2b2f1b6ca'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.289004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dc1cd654-13b7-464e-aedd-f605050f8fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f57e2287dc3474db2de9bf2b2f1b6ca'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.298971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1093/2174] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:01 2022] DELETE /identity/v3/users/7f57e2287dc3474db2de9bf2b2f1b6ca => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:01.726532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:01.728917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:01.752917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42ea3-781a-4486-8c7d-1bdefd93c4f4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:01.801220 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:01.863941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:01.869367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:01.869964 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:01.870559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] PATH_INFO: `/v3/projects/7c1a10ad066444898937b448d4baa97e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:01.872530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1a10ad066444898937b448d4baa97e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:01.874535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:01.931392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1a10ad066444898937b448d4baa97e', 'request_id': 'req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.939595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1a10ad066444898937b448d4baa97e', 'request_id': 'req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.955192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1a10ad066444898937b448d4baa97e', 'request_id': 'req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.970627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] The token cache is being invalidate because project 7c1a10ad066444898937b448d4baa97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:01.970919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.971574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d05e0cf6-8ba4-487f-9e6e-b5fecff429ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:01.973208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1082/2175] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:01 2022] DELETE /identity/v3/projects/7c1a10ad066444898937b448d4baa97e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:01.979200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:01.979713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:01.979820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:01.997719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:01.998927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:02.036227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:02.072894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1094/2176] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:02.081915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.082352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.082707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.103377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:02.104909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:02.115011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1083/2177] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:02.119564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.130771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953dec7-8fdd-433e-b4df-bf2797a34480 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.135972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.136648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.136942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.137312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.138673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:02.138993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.140691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.152941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1095/2178] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:02.157696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.167162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f1bb-00ad-4c87-a4ad-53b2440ef7c2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.172008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.172737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.173045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.173307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.174031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.175989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.204755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1084/2179] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:02 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:02.209740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.220741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bad9dc-1d19-4de3-be10-53185fa2df32 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.299519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.300471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.300928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.301352 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.302215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.304747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.330129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1096/2180] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:02 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:02.335688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.348548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e82ea-1eef-4d31-9488-3fd0bc073ebe admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.354073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.354778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.355064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.355344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.356085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.358379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.373920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.374817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1085/2181] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:02.385123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691ff01-4bf4-4b16-bf1d-de8cad280413 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.391154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df4a5-07fd-4044-be95-781ec24a7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.392622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df4a5-07fd-4044-be95-781ec24a7819 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.392622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df4a5-07fd-4044-be95-781ec24a7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.392622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df4a5-07fd-4044-be95-781ec24a7819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.393539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3df4a5-07fd-4044-be95-781ec24a7819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.397614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3df4a5-07fd-4044-be95-781ec24a7819 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.413091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1097/2182] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:02.414958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.425852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833562dd-502d-459e-8f46-2fcfaf00d5e2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.431091 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.432235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.432734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.433286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] PATH_INFO: `/v3/projects/dc3009b3ce2649a6b463db43abc94931/users/477d1a1a2a214e3fb23ad3c148ced947/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.456482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3009b3ce2649a6b463db43abc94931, user_id=477d1a1a2a214e3fb23ad3c148ced947, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.460961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.484234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1086/2183] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:02 2022] PUT /identity/v3/projects/dc3009b3ce2649a6b463db43abc94931/users/477d1a1a2a214e3fb23ad3c148ced947/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:02.495646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.496143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.496426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.537353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] MFA Rules not processed for user `477d1a1a2a214e3fb23ad3c148ced947`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:02.539349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:02.615572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1098/2184] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:02.620567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.697332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:02.707780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2ccfd-ee67-4616-82f9-e8fb6aafc433 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.717953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.718395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.718687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.718973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.719902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.722132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.764378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1087/2185] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:02 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:02.767916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.780397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1d7d-2674-49a8-9a5d-33c750a12ca5 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.824449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:02.865508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.866870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.867366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.867857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.868866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.872145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:02.931367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1099/2186] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:02 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:02.935279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:02.961334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1b60-4e7c-4f3f-a8a4-4d5c135b209e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:02.981281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:02.983808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:02.984110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:02.984399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:02.985197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:02.993896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.014699 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1088/2187] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:03.019089 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.033591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15bb79-341a-4f8e-8e55-35c9937e2c30 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.043293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258cd78-8c4b-4e59-a96f-941976ee4c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.044272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258cd78-8c4b-4e59-a96f-941976ee4c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.044729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258cd78-8c4b-4e59-a96f-941976ee4c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.045255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258cd78-8c4b-4e59-a96f-941976ee4c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.046318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258cd78-8c4b-4e59-a96f-941976ee4c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.048294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258cd78-8c4b-4e59-a96f-941976ee4c6e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.081804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1100/2188] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:03.086359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.098825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff934ee-4773-4ac2-8b4a-72bea1a927eb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.104117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.105111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.105467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.105811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] PATH_INFO: `/v3/projects/ceaca468c94d4c68add066fd67eb3f72/users/3d20e7488cb74755b1e2ea73e888e878/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.126507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceaca468c94d4c68add066fd67eb3f72, user_id=3d20e7488cb74755b1e2ea73e888e878, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.130022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.153063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1089/2189] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:03 2022] PUT /identity/v3/projects/ceaca468c94d4c68add066fd67eb3f72/users/3d20e7488cb74755b1e2ea73e888e878/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:03.162967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.163488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.163795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.195759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] MFA Rules not processed for user `3d20e7488cb74755b1e2ea73e888e878`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:03.197132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:03.310954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1101/2190] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:03.318145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.418453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50652d43-4b56-458d-adcb-ae02febe5e80 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.424052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.424784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.425386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.425601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.426322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.428594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.469922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1090/2191] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:03 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:03.470598 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.485609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c73cd-fd2f-4047-838a-08acc5454d23 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.565898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.566704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.567226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.568239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.569499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.571578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.617776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.620655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1102/2192] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:03 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:03.642060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff5202-60b9-4498-9dad-6f155a3d75c5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.649351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.650371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.650669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.651294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.652333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.655686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.675148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1091/2193] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:03.679537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.694848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498843-6d7c-4492-84c1-3bb54e90694c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.715171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.716148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.716434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.716739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] PATH_INFO: `/v3/projects/291c65de504344e5a7fa6ba61881001e/users/075b523f9e9e4a7aa7de6e373764ed54/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.742785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291c65de504344e5a7fa6ba61881001e, user_id=075b523f9e9e4a7aa7de6e373764ed54, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.745859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.778881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1103/2194] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:03 2022] PUT /identity/v3/projects/291c65de504344e5a7fa6ba61881001e/users/075b523f9e9e4a7aa7de6e373764ed54/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:03.779448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.795254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015148-d6d5-46a4-b23c-8c1b02a53e2d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.875708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3269-8ea3-41fd-84f0-aa1b3167c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.876380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3269-8ea3-41fd-84f0-aa1b3167c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.876715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3269-8ea3-41fd-84f0-aa1b3167c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.877003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3269-8ea3-41fd-84f0-aa1b3167c5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.878857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe3269-8ea3-41fd-84f0-aa1b3167c5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.879811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe3269-8ea3-41fd-84f0-aa1b3167c5a6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.893299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1092/2195] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:03.897902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:03.912043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b28c31-8f5a-4eb1-80f9-d77db8e6ac49 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:03.924252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:03.925927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.925927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.926146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] PATH_INFO: `/v3/projects/291c65de504344e5a7fa6ba61881001e/users/075b523f9e9e4a7aa7de6e373764ed54/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:03.928879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] RBAC: Authorizing `identity:create_grant(project_id=291c65de504344e5a7fa6ba61881001e, user_id=075b523f9e9e4a7aa7de6e373764ed54, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:03.935577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:03.937924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:03.963087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1104/2196] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:03 2022] PUT /identity/v3/projects/291c65de504344e5a7fa6ba61881001e/users/075b523f9e9e4a7aa7de6e373764ed54/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:03.975634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:03.975960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:03.976707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:04.006570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] MFA Rules not processed for user `075b523f9e9e4a7aa7de6e373764ed54`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:04.007827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:04.012323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:04.098763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1093/2197] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:04.115902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:04.118623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:04.205344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b1f62-e66b-4c43-bda8-95f8e95d483f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:04.209598 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4905d-6ae3-4cdb-982f-49f65d1a3211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:04.212522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4905d-6ae3-4cdb-982f-49f65d1a3211 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:04.212522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4905d-6ae3-4cdb-982f-49f65d1a3211 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:04.212522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4905d-6ae3-4cdb-982f-49f65d1a3211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:04.375530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4905d-6ae3-4cdb-982f-49f65d1a3211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:04.384809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4905d-6ae3-4cdb-982f-49f65d1a3211 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:04.391231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1105/2198] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:04.923832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:04.938443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b5588-379c-4410-90bd-c5e3211804bd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:04.943044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:04.944021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:04.944461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:04.944933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:04.948121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:05.039779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.040090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.041146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.047249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.048812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.063437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1094/2199] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:05.105608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] MFA Rules not processed for user `dc9c9dd337834dea821cc4ea6ecc10a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:05.106970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:05.182553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1106/2200] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:05.186972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:05.188551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:05.260305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcd0dc-5b08-4426-8d25-fea76a3655d7 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:05.268562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:05.269288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.271116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.271402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.272123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.274109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.305393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1095/2201] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:05 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:05.310719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:05.329330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af294-c89b-49f3-a29c-dac747384a35 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:05.374103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:05.416688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:05.417851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.418320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.418657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.420170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.423307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.475492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1107/2202] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:05 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:05.479509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:05.505212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055bc69-dd47-4393-b6d8-bcc4379249da admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:05.509851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:05.510645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.510973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.511314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.513640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.514498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.526544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1096/2203] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:05.531706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:05.545050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880a34c-275f-4759-91a8-a0b6de3b56f9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:05.551171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:05.551995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.552382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.552845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] PATH_INFO: `/v3/projects/a886bc50cd744119b6eddf9d71f2c7ae/users/5a10006c34894a1ebac9d75b1a19e8f9/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.569328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a886bc50cd744119b6eddf9d71f2c7ae, user_id=5a10006c34894a1ebac9d75b1a19e8f9, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.572431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.594357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1108/2204] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:05 2022] PUT /identity/v3/projects/a886bc50cd744119b6eddf9d71f2c7ae/users/5a10006c34894a1ebac9d75b1a19e8f9/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:05.601720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:05.614382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f12e1f-4b6a-4edc-b1f9-ab6a9084fa50 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:05.619458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:05.685692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:05.686364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.686655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.686974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.687754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.689513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.701163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1097/2205] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:05.705384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:05.717977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fb1cc-5c78-4094-bfb7-840aa192b3e3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:05.723659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:05.724635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:05.725034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:05.725313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] PATH_INFO: `/v3/projects/a886bc50cd744119b6eddf9d71f2c7ae/users/5a10006c34894a1ebac9d75b1a19e8f9/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:05.728142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a886bc50cd744119b6eddf9d71f2c7ae, user_id=5a10006c34894a1ebac9d75b1a19e8f9, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:05.731379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:05.743377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1109/2206] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:05 2022] PUT /identity/v3/projects/a886bc50cd744119b6eddf9d71f2c7ae/users/5a10006c34894a1ebac9d75b1a19e8f9/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:06.280726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:06.283572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:06.421004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f3fa-2b49-4e1a-9433-4dee95f045c1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:06.533373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b1637-61ab-4db4-ac01-8893474ede80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:06.535016 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b1637-61ab-4db4-ac01-8893474ede80 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:06.535333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b1637-61ab-4db4-ac01-8893474ede80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:06.535616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b1637-61ab-4db4-ac01-8893474ede80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:06.625392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b1637-61ab-4db4-ac01-8893474ede80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:06.626874 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b1637-61ab-4db4-ac01-8893474ede80 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:06.639191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1098/2207] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:09.264483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:09.276288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b451-e45f-4574-88f6-1e548781b799 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:09.281186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:09.282460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:09.282736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:09.283067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:09.450916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:09.454283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:09.474719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1110/2208] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:12.042873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:12.043385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:12.043462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:12.079127 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] MFA Rules not processed for user `5a10006c34894a1ebac9d75b1a19e8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:12.080929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:12.086204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:12.181186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1099/2209] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:12.202733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:12.204183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:12.298667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb62f6-e859-40ad-8f56-67148c52b979 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:12.304495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f2b9e-6c14-4546-8834-2d0fa2e4711e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:12.305187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2b9e-6c14-4546-8834-2d0fa2e4711e service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:12.305469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2b9e-6c14-4546-8834-2d0fa2e4711e service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:12.305744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2b9e-6c14-4546-8834-2d0fa2e4711e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:12.330205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:12.383098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2b9e-6c14-4546-8834-2d0fa2e4711e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:12.386305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2b9e-6c14-4546-8834-2d0fa2e4711e service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:12.399538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1111/2210] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:16.893650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:16.991825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed694-9992-4d9d-84fe-238d3a6bcfa3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:16.996737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:16.997636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:16.997921 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:16.998237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] PATH_INFO: `/v3/users/477d1a1a2a214e3fb23ad3c148ced947` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:16.999612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477d1a1a2a214e3fb23ad3c148ced947)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:17.001867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:17.072307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477d1a1a2a214e3fb23ad3c148ced947'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.073226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477d1a1a2a214e3fb23ad3c148ced947'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.091618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477d1a1a2a214e3fb23ad3c148ced947'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.100484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477d1a1a2a214e3fb23ad3c148ced947'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.101510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477d1a1a2a214e3fb23ad3c148ced947'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.121274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1100/2211] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:16 2022] DELETE /identity/v3/users/477d1a1a2a214e3fb23ad3c148ced947 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:17.126037 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.126536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.126622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.151786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:17.153409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:17.248635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1112/2212] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:17.257216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:17.258223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:17.258816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:17.259574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:17.273314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0804e-c954-43fc-b9ae-ff79fe84b032 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:17.278052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:17.279021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.279343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.279700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] PATH_INFO: `/v3/users/df8950108a3a4be483620c18b6ed6aa4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.281027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8950108a3a4be483620c18b6ed6aa4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:17.282971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:17.299208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:17.322904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b00d8-7fe1-4a9c-a816-8f9a2cbbb784 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:17.327604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd88b3-c207-4f45-879d-11888fcc2813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:17.328351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd88b3-c207-4f45-879d-11888fcc2813 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.328783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd88b3-c207-4f45-879d-11888fcc2813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.329104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd88b3-c207-4f45-879d-11888fcc2813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.335609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8950108a3a4be483620c18b6ed6aa4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.336378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8950108a3a4be483620c18b6ed6aa4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.339620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd88b3-c207-4f45-879d-11888fcc2813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:17.341183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd88b3-c207-4f45-879d-11888fcc2813 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:17.349198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8950108a3a4be483620c18b6ed6aa4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.350870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1113/2213] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:17.358092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8950108a3a4be483620c18b6ed6aa4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.358854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8950108a3a4be483620c18b6ed6aa4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.377655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1101/2214] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:17 2022] DELETE /identity/v3/users/df8950108a3a4be483620c18b6ed6aa4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:17.383246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.383536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.383814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.406348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:17.407780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:17.485453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1114/2215] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:17.496549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:17.498502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:17.580319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2053f-7cf7-4678-b4af-30e98ff6dfda admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:17.584379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:17.585084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.585366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.585640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.598982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:17.600473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:17.616949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1102/2216] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:17.711655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:17.714071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:17.729658 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc196d6-716b-47c7-b26b-9bc14a691056 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:17.751890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:17.753384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.753900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.754340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] PATH_INFO: `/v3/projects/dc3009b3ce2649a6b463db43abc94931` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.755777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3009b3ce2649a6b463db43abc94931)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:17.758451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:17.761048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:17.831606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3009b3ce2649a6b463db43abc94931', 'request_id': 'req-19082a38-a2b7-438a-9a59-3251c7142220'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.842284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3009b3ce2649a6b463db43abc94931', 'request_id': 'req-19082a38-a2b7-438a-9a59-3251c7142220'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.859776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3009b3ce2649a6b463db43abc94931', 'request_id': 'req-19082a38-a2b7-438a-9a59-3251c7142220'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.875043 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] The token cache is being invalidate because project dc3009b3ce2649a6b463db43abc94931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:17.875735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.876465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:17.878523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1115/2217] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:17 2022] DELETE /identity/v3/projects/dc3009b3ce2649a6b463db43abc94931 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:17.882719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:17.893307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300dfb7-98fc-48e8-8c0c-2d5a0127ca67 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:17.983303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:17.984241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:17.984498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:17.984813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] PATH_INFO: `/v3/users/3d20e7488cb74755b1e2ea73e888e878` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:17.989539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d20e7488cb74755b1e2ea73e888e878)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:17.994218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:17.994610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:17.997755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:18.025624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082a38-a2b7-438a-9a59-3251c7142220 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:18.031790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:18.035025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:18.035025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:18.035025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] PATH_INFO: `/v3/projects/df479df5b04b4ba7a9bdb15ee44eb250` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:18.035025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df479df5b04b4ba7a9bdb15ee44eb250)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:18.038898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:18.052830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:18.066128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d20e7488cb74755b1e2ea73e888e878'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.067084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d20e7488cb74755b1e2ea73e888e878'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.083071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d20e7488cb74755b1e2ea73e888e878'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.092799 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d20e7488cb74755b1e2ea73e888e878'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.093557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d20e7488cb74755b1e2ea73e888e878'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.097888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df479df5b04b4ba7a9bdb15ee44eb250', 'request_id': 'req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.107770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df479df5b04b4ba7a9bdb15ee44eb250', 'request_id': 'req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.109302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1103/2218] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:17 2022] DELETE /identity/v3/users/3d20e7488cb74755b1e2ea73e888e878 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:18.115028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df479df5b04b4ba7a9bdb15ee44eb250', 'request_id': 'req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.147233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] The token cache is being invalidate because project df479df5b04b4ba7a9bdb15ee44eb250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:18.148479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.149976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.155071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1116/2219] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:17 2022] DELETE /identity/v3/projects/df479df5b04b4ba7a9bdb15ee44eb250 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:18.157118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:18.158802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:18.293197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbedc8a-84c6-4789-bb09-98adc756dd0e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:18.298942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:18.299856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:18.300170 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:18.303423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] PATH_INFO: `/v3/users/2e183d034d6a4ae5a8f0d8910421f7e9` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:18.307258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e183d034d6a4ae5a8f0d8910421f7e9)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:18.309116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:18.373638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e183d034d6a4ae5a8f0d8910421f7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.374378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e183d034d6a4ae5a8f0d8910421f7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.398243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e183d034d6a4ae5a8f0d8910421f7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.410675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e183d034d6a4ae5a8f0d8910421f7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.411507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e183d034d6a4ae5a8f0d8910421f7e9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.437566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1104/2220] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:18 2022] DELETE /identity/v3/users/2e183d034d6a4ae5a8f0d8910421f7e9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:18.485596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:18.488550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:18.590814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e0ff-d843-40e1-9740-a0a3d0a61c77 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:18.609566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:18.673616 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:18.674569 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:18.674834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:18.675112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] PATH_INFO: `/v3/projects/ceaca468c94d4c68add066fd67eb3f72` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:18.678990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceaca468c94d4c68add066fd67eb3f72)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:18.681169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:18.757494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceaca468c94d4c68add066fd67eb3f72', 'request_id': 'req-f8a5389d-70da-4049-8982-514d7cadf8e5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.767503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceaca468c94d4c68add066fd67eb3f72', 'request_id': 'req-f8a5389d-70da-4049-8982-514d7cadf8e5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.773985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceaca468c94d4c68add066fd67eb3f72', 'request_id': 'req-f8a5389d-70da-4049-8982-514d7cadf8e5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.789439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] The token cache is being invalidate because project ceaca468c94d4c68add066fd67eb3f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:18.789439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.789439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.789439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1117/2221] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:18 2022] DELETE /identity/v3/projects/ceaca468c94d4c68add066fd67eb3f72 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:18.793589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:18.803158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:18.817874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:18.819632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:18.820730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f360-9086-46d9-99d0-2ced5d949916 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:18.855192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:18.883887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:18.884818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:18.885111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:18.885383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] PATH_INFO: `/v3/users/075b523f9e9e4a7aa7de6e373764ed54` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:18.886712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=075b523f9e9e4a7aa7de6e373764ed54)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:18.889103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:18.897436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5389d-70da-4049-8982-514d7cadf8e5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:18.905244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:18.906144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:18.906427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:18.906699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] PATH_INFO: `/v3/projects/d1a528a66ca64a2288c443180649be7f` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:18.907926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a528a66ca64a2288c443180649be7f)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:18.909926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:18.937789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075b523f9e9e4a7aa7de6e373764ed54'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.938504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075b523f9e9e4a7aa7de6e373764ed54'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.952168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075b523f9e9e4a7aa7de6e373764ed54'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.960485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075b523f9e9e4a7aa7de6e373764ed54'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.961387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075b523f9e9e4a7aa7de6e373764ed54'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.965050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a528a66ca64a2288c443180649be7f', 'request_id': 'req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.967593 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:18.973348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a528a66ca64a2288c443180649be7f', 'request_id': 'req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.976969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1105/2222] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:18 2022] DELETE /identity/v3/users/075b523f9e9e4a7aa7de6e373764ed54 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:18.983496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a528a66ca64a2288c443180649be7f', 'request_id': 'req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:18.999907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] The token cache is being invalidate because project d1a528a66ca64a2288c443180649be7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:19.000306 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.001169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-191cf23a-b2b6-4047-8ce5-dcd24e6c0c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.003254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1118/2223] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:18 2022] DELETE /identity/v3/projects/d1a528a66ca64a2288c443180649be7f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:19.007688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.008251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eecd-1d43-4d36-b440-b3f7a353fc2e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.008401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eecd-1d43-4d36-b440-b3f7a353fc2e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.008716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01eecd-1d43-4d36-b440-b3f7a353fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.009612 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.028908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9f01eecd-1d43-4d36-b440-b3f7a353fc2e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:19.030220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9f01eecd-1d43-4d36-b440-b3f7a353fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.091639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed353358-6ffa-4c7f-8f26-ba3d3b680a3a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.097671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.098904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.099360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.099813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] PATH_INFO: `/v3/users/7175536238b4464682f8b7a7beb509f3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.101222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7175536238b4464682f8b7a7beb509f3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.103203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.114592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1119/2224] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:19.117565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.117953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.118562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.143867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:19.145193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.164164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1120/2225] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:19.165327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.177325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0897-02f2-4575-acba-52f584e0a126 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.190211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.191158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.191578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.191997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.192246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7175536238b4464682f8b7a7beb509f3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.193194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:19.193329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7175536238b4464682f8b7a7beb509f3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.193968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.195947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.200742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:19.211617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7175536238b4464682f8b7a7beb509f3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.220967 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1121/2226] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:19.222453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.233718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7175536238b4464682f8b7a7beb509f3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.234990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4842e4e4-3ab7-44c7-9f1c-d057d67fd4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7175536238b4464682f8b7a7beb509f3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.237023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1be1-b2a4-42f2-9545-0a16335da86a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.242113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.242719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.243041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.243696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.244009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.245958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.253243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1106/2227] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:19 2022] DELETE /identity/v3/users/7175536238b4464682f8b7a7beb509f3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:19.258444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.258444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.258710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.280708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1122/2228] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:19.283089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:19.284419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.286719 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.293504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.381370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1107/2229] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:19.394302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.396408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.408431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4a6c-393f-4a3c-94e5-7720e9ea4161 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.413247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.414022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.414224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.414504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.415294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.417310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.438271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7f4d1-1ce4-490a-8e16-28209a7c31ee None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.444625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.445604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.445928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.446180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] PATH_INFO: `/v3/projects/291c65de504344e5a7fa6ba61881001e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.447399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291c65de504344e5a7fa6ba61881001e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.449532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.452834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1123/2230] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:19.454435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.456163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.497867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:19.512225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291c65de504344e5a7fa6ba61881001e', 'request_id': 'req-41e76f50-4e44-4b5a-b4c6-9029b8e43326'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.520469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291c65de504344e5a7fa6ba61881001e', 'request_id': 'req-41e76f50-4e44-4b5a-b4c6-9029b8e43326'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.529479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6069b5-b308-4827-a73b-66fcd3d6a979 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.537272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291c65de504344e5a7fa6ba61881001e', 'request_id': 'req-41e76f50-4e44-4b5a-b4c6-9029b8e43326'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.556895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] The token cache is being invalidate because project 291c65de504344e5a7fa6ba61881001e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:19.557338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.559357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:19.566706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1108/2231] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:19 2022] DELETE /identity/v3/projects/291c65de504344e5a7fa6ba61881001e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:19.566706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.566706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.604374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.605114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.605519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.605954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.607859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.632317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:19.639095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e76f50-4e44-4b5a-b4c6-9029b8e43326 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.646448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f2c46-8a32-4bb4-8efc-4bec3e31482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.647325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2c46-8a32-4bb4-8efc-4bec3e31482a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.647959 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2c46-8a32-4bb4-8efc-4bec3e31482a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.648715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2c46-8a32-4bb4-8efc-4bec3e31482a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.649747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f2c46-8a32-4bb4-8efc-4bec3e31482a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.652739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f2c46-8a32-4bb4-8efc-4bec3e31482a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.668826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1109/2232] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:19.670386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fe8e1-4428-430a-9f40-d590e71a4c6b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.670794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fe8e1-4428-430a-9f40-d590e71a4c6b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.671457 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fe8e1-4428-430a-9f40-d590e71a4c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.689611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.691155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.694173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7d4fe8e1-4428-430a-9f40-d590e71a4c6b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:19.695476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7d4fe8e1-4428-430a-9f40-d590e71a4c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.701851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1124/2233] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:19.704501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1110/2234] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:19.710491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.713630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.713630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.713630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.733096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d005ef7-b05b-4051-a6df-405164cf708f service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.738340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:19.739667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:19.740292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.741489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.741852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.742281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.744430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.746287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.749397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1111/2235] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:19.754348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.769401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538f468-e34b-43e6-820a-3a78156ad6ea None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.775369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.776225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.776522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.776894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1125/2236] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:19.777298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.778079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.778445 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:19.778905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.781554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.800648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1112/2237] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:19.806303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.807338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda3fc3-b7c9-42b9-96db-e7da3501ceb5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.813651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f654937-e425-492d-86d7-8e606f4af9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.814700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654937-e425-492d-86d7-8e606f4af9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.814984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654937-e425-492d-86d7-8e606f4af9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.815266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654937-e425-492d-86d7-8e606f4af9b8 admin admin] PATH_INFO: `/v3/projects/9fdce18f275642788585a401e7fafbc7/users/173bf211785f46f2a4cb9120203c4086/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.821291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f6e6-b6a2-47df-94dc-43dfdc2600f3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:19.827452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:19.828179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.828702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.828937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.829682 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.831685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.846496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f654937-e425-492d-86d7-8e606f4af9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdce18f275642788585a401e7fafbc7, user_id=173bf211785f46f2a4cb9120203c4086, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:19.854535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f654937-e425-492d-86d7-8e606f4af9b8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:19.872775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1126/2238] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:19 2022] PUT /identity/v3/projects/9fdce18f275642788585a401e7fafbc7/users/173bf211785f46f2a4cb9120203c4086/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:19.872943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1113/2239] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:19.885054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:19.886025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:19.886556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:19.890506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:19.967970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] MFA Rules not processed for user `173bf211785f46f2a4cb9120203c4086`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:19.969234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.008675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613672-7aa5-43b5-9d76-3a12eaba4f41 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.016374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.017551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.017946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.019543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.020301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.023602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.040102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:20.054468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1114/2240] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:20.057573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.063974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1127/2241] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:20.068161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2db682-4a9d-4201-9f05-5f58b104b129 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.068294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.077718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.078164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.078454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.078732 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.079568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.081227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.083012 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade69a6a-dea4-4de1-8590-a4fabfffc39e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.088503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.089206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.089490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.089772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.090573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.092890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.094109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1115/2242] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:20.098263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.109463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1616b3-0534-42d7-b794-db637a324491 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.115122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.115816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.116123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.116422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.120327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.121827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.123241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1128/2243] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:20.124077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.125893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.134797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1116/2244] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:20.135687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.146768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640bbba-b536-4651-8cb8-62d8a06fdaf8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.200124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935685cd-578e-4c22-9488-ec058f2545d0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.204759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.205225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.205640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.205910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.206009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.206183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] PATH_INFO: `/v3/projects/a429cc84f87c4acea8a43c256d079ecc` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.206281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.206463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.207272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.207378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a429cc84f87c4acea8a43c256d079ecc)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.209266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.209375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.226159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:20.234791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1117/2245] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:20.235761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.245885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6069a-8ac3-41ed-9d56-e7b94a4f0a30 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.258581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a429cc84f87c4acea8a43c256d079ecc', 'request_id': 'req-d2bc3f37-d948-4710-a913-27532effbfcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:20.267916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a429cc84f87c4acea8a43c256d079ecc', 'request_id': 'req-d2bc3f37-d948-4710-a913-27532effbfcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:20.275328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a429cc84f87c4acea8a43c256d079ecc', 'request_id': 'req-d2bc3f37-d948-4710-a913-27532effbfcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:20.286835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] The token cache is being invalidate because project a429cc84f87c4acea8a43c256d079ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:20.287127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:20.287835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:20.292752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1129/2246] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:20 2022] DELETE /identity/v3/projects/a429cc84f87c4acea8a43c256d079ecc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:20.292752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.292752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.305934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172dca-a2ab-438c-8d2a-89c255c4bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.306840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172dca-a2ab-438c-8d2a-89c255c4bd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.307128 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172dca-a2ab-438c-8d2a-89c255c4bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.307403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172dca-a2ab-438c-8d2a-89c255c4bd43 admin admin] PATH_INFO: `/v3/projects/31c15be59539430b9f25b8236c4d03c7/users/b88d284f57a44ddcb0f1347942a2950b/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.322577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172dca-a2ab-438c-8d2a-89c255c4bd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c15be59539430b9f25b8236c4d03c7, user_id=b88d284f57a44ddcb0f1347942a2950b, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.325724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172dca-a2ab-438c-8d2a-89c255c4bd43 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.345042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1118/2247] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:20 2022] PUT /identity/v3/projects/31c15be59539430b9f25b8236c4d03c7/users/b88d284f57a44ddcb0f1347942a2950b/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:20.345042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.345042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.345042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.358429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:20.363344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc3f37-d948-4710-a913-27532effbfcf admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.373463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:20.375188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.425456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe86a9-599c-4925-979e-0486744a9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.426139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe86a9-599c-4925-979e-0486744a9f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.426427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe86a9-599c-4925-979e-0486744a9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.426706 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe86a9-599c-4925-979e-0486744a9f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.427680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe86a9-599c-4925-979e-0486744a9f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.429098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe86a9-599c-4925-979e-0486744a9f39 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.438944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1130/2248] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:20.440246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934424f3-6d37-4ba6-9967-8f3228dcb635 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.440539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934424f3-6d37-4ba6-9967-8f3228dcb635 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.441116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934424f3-6d37-4ba6-9967-8f3228dcb635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.446280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1119/2249] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:20.452165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.460720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-934424f3-6d37-4ba6-9967-8f3228dcb635 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:20.461587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37fab2-e8fc-4841-919e-3c1fc2bee660 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.461919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-934424f3-6d37-4ba6-9967-8f3228dcb635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.466237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.467208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.467503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.467788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] PATH_INFO: `/v3/projects/d5029ff5d8d94b0096963891e4a145a3/users/10ede9cb751e4981a60648bf26a92299/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.469846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1131/2250] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:20.471108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.471397 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.471670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.491724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5029ff5d8d94b0096963891e4a145a3, user_id=10ede9cb751e4981a60648bf26a92299, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.494480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.498117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:20.499749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.508896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1132/2251] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:20.509515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1120/2252] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:20 2022] PUT /identity/v3/projects/d5029ff5d8d94b0096963891e4a145a3/users/10ede9cb751e4981a60648bf26a92299/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:20.509692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.510981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.513588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.573496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26f50-1675-437f-aa41-546469feee08 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.582543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bafd0-0868-496f-84b5-b97197c08bc2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.588207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.588915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.589315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.589602 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.590432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:20.590738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.592477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.595095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:20.609370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1121/2253] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:19:20.609370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.616973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fdd1f-0fb8-41f8-acff-7f25210822cd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.621738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.622394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.622676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.623085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.623845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.625475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.634773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.635406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.635531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1122/2254] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:20.635712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.635960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.636224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.646564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.648291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.648793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e8f4-00bc-4d72-9557-934b8e880ece admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.655752 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.656467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.656798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.657076 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.657816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.659986 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.660098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1133/2255] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:20.660667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.672914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10753d3-1649-446c-95b5-d36acaa66eb6 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.678898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d2e7d-2707-4efe-99cb-b033d9892543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.680022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d2e7d-2707-4efe-99cb-b033d9892543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.680321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d2e7d-2707-4efe-99cb-b033d9892543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.680676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d2e7d-2707-4efe-99cb-b033d9892543 admin admin] PATH_INFO: `/v3/projects/d5029ff5d8d94b0096963891e4a145a3/users/10ede9cb751e4981a60648bf26a92299/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.683221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d2e7d-2707-4efe-99cb-b033d9892543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5029ff5d8d94b0096963891e4a145a3, user_id=10ede9cb751e4981a60648bf26a92299, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.686202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d2e7d-2707-4efe-99cb-b033d9892543 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.694192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1123/2256] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:20.695278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.703170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1134/2257] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:20 2022] PUT /identity/v3/projects/d5029ff5d8d94b0096963891e4a145a3/users/10ede9cb751e4981a60648bf26a92299/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:20.714571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.715256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.715256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.747876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] MFA Rules not processed for user `10ede9cb751e4981a60648bf26a92299`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:20.749355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.774973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:20.783978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8e63-bf06-4c55-a580-fc215e423619 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.852280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1135/2258] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:20.860313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.861800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.862092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:20.862663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.863182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.863511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.864253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.866517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.899385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1124/2259] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:20 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:20.902250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.920706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f647-0b0a-473f-bfd6-32bd781edaaa admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.925584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.926273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.926561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.927098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.927581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.929249 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.939928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1125/2260] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:20.941164 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9552770-027e-4ce3-8889-75d7670cf370 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.943807 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.945340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.946003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.946639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.946922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.954838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359df45f-f08c-4aef-8d6c-eb7cb774478e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:20.958693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.960183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.960288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:20.960951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:20.961302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:20.961644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:20.962511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:20.964198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:20.970297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1136/2261] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:19:20.977184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1126/2262] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:20.981733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:20.996072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f54cd4-8269-4a07-bc73-09e3914d40d7 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:21.003194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa92dda-e649-4a94-ab9b-14e48623e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:21.004146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92dda-e649-4a94-ab9b-14e48623e77e admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.005138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92dda-e649-4a94-ab9b-14e48623e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.005138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92dda-e649-4a94-ab9b-14e48623e77e admin admin] PATH_INFO: `/v3/projects/be0477238aa04d08a9caad52df6f09bd/users/50f910d9b5c2453d857e152659beb9b3/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.028500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:21.030890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.033149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92dda-e649-4a94-ab9b-14e48623e77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0477238aa04d08a9caad52df6f09bd, user_id=50f910d9b5c2453d857e152659beb9b3, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:21.035974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92dda-e649-4a94-ab9b-14e48623e77e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:21.045834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a18-17d6-4f08-ac17-93305b9a4ace admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:21.050314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:21.051183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.051675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.052701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.060051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.082817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1137/2263] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:20 2022] PUT /identity/v3/projects/be0477238aa04d08a9caad52df6f09bd/users/50f910d9b5c2453d857e152659beb9b3/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:21.085091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.085091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.085584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.115020 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:21.132321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] MFA Rules not processed for user `50f910d9b5c2453d857e152659beb9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:21.133702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.147782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:21.149468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:21.161447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1127/2264] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:19:21.209565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1138/2265] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:21.221104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:21.230782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d71a6-67fb-4c03-82ac-8a69695fa0cd service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:21.286671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fba6b-010b-4f1f-88e4-9541e72e552f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:21.287239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fba6b-010b-4f1f-88e4-9541e72e552f service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.287622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fba6b-010b-4f1f-88e4-9541e72e552f service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.288804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fba6b-010b-4f1f-88e4-9541e72e552f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.298563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fba6b-010b-4f1f-88e4-9541e72e552f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:21.300292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fba6b-010b-4f1f-88e4-9541e72e552f service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:21.311261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1128/2266] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:21.341384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:21.385517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:21.403649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.404819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.404819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.444076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44342bd-ef8e-4faf-bd41-96a6f7c702bf None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:21.449167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] MFA Rules not processed for user `b88d284f57a44ddcb0f1347942a2950b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:21.450001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:21.450930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.451282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.451697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] PATH_INFO: `/v3/users/50f910d9b5c2453d857e152659beb9b3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.452164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.453210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f910d9b5c2453d857e152659beb9b3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:21.455636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:21.531324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f910d9b5c2453d857e152659beb9b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:21.541365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f910d9b5c2453d857e152659beb9b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:21.581920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f910d9b5c2453d857e152659beb9b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:21.582762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f910d9b5c2453d857e152659beb9b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:21.586596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1129/2267] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:21.600018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-959257b4-0d89-4f90-9845-532b2a3fbbdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f910d9b5c2453d857e152659beb9b3'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:21.602535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:21.609439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1139/2268] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:21 2022] DELETE /identity/v3/users/50f910d9b5c2453d857e152659beb9b3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:21.614577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.615028 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.615475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.619193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548e6c7-ad16-4719-96e1-bfcbd471d274 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:21.640749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:21.642633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.679069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:21.679830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.680253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.680581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.683944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.712213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:21.715347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1140/2269] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:21.725993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:21.727435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:21.758227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:21.759625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:21.769610 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1130/2270] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:21.782541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:21.802207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb098f9-9b6d-4cc3-bc40-bce83bb7fde2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:21.807056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fdc91-1e61-4e76-bd65-f32fff073fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:21.808022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fdc91-1e61-4e76-bd65-f32fff073fee service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:21.808517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fdc91-1e61-4e76-bd65-f32fff073fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:21.808992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fdc91-1e61-4e76-bd65-f32fff073fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:21.822191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fdc91-1e61-4e76-bd65-f32fff073fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:21.823709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fdc91-1e61-4e76-bd65-f32fff073fee service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:21.834117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1141/2271] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:22.128757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.130654 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:22.149461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50691d53-937e-4bd0-93de-ddae494c565e service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.154458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.155507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.164000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.164295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] PATH_INFO: `/v3/projects/be0477238aa04d08a9caad52df6f09bd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.165653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0477238aa04d08a9caad52df6f09bd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.168028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.216103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0477238aa04d08a9caad52df6f09bd', 'request_id': 'req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:22.222595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0477238aa04d08a9caad52df6f09bd', 'request_id': 'req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:22.231438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0477238aa04d08a9caad52df6f09bd', 'request_id': 'req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:22.241920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] The token cache is being invalidate because project be0477238aa04d08a9caad52df6f09bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:22.242206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:22.242825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b8d8a4a-657e-4a00-bff8-abaaf4553ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:22.244368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1131/2272] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:22 2022] DELETE /identity/v3/projects/be0477238aa04d08a9caad52df6f09bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:22.249479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.249970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.250072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.271994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:22.273218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:22.333834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1142/2273] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:22.342104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.342396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.342677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.362999 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:22.364251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:22.373143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1132/2274] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:22.377585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.388342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb480e-586e-4ce8-bd14-632beb68c75a None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.393863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.394532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.394819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.395101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.395838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:22.396157 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.397831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.409655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1143/2275] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:22.414226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.424486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb558-32b3-4cc4-8f94-e5212fd48c0c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.429183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.429876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.430165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.430458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.431171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.433740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.462063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1133/2276] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:22 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:22.466594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.482057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584faf7-bc5a-4cad-aeb5-63a8d7f713cf admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.549125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.549746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.550036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.550318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.551018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.553021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.589722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1144/2277] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:22 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:22.591084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.603838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdfc30-92e3-4a9d-a14a-cb03ccda8067 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.609763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.610507 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.610766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.611040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.611780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.613573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.630322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1134/2278] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:22.631769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.644737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934d0d9-87f4-4534-9718-9fef3afc5457 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.652444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd8863-3df6-4520-b396-6aaa5bd24748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.653925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd8863-3df6-4520-b396-6aaa5bd24748 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.654176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd8863-3df6-4520-b396-6aaa5bd24748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.654434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd8863-3df6-4520-b396-6aaa5bd24748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.655496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd8863-3df6-4520-b396-6aaa5bd24748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.657681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd8863-3df6-4520-b396-6aaa5bd24748 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.678167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1145/2279] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:22.679484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.692835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63875e-3388-48da-8a76-540c1d22b50c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.698335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.699247 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.699540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.699968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] PATH_INFO: `/v3/projects/0cc6a8ff9f92432ba9433b78a948d042/users/63d18c022a19438d88562ef8e8c3fbce/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.717701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc6a8ff9f92432ba9433b78a948d042, user_id=63d18c022a19438d88562ef8e8c3fbce, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.722264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.740877 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1135/2280] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:22 2022] PUT /identity/v3/projects/0cc6a8ff9f92432ba9433b78a948d042/users/63d18c022a19438d88562ef8e8c3fbce/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:22.746361 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b84072-b9e2-40a0-84df-d9056cdbb137 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.746531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b84072-b9e2-40a0-84df-d9056cdbb137 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.746815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b84072-b9e2-40a0-84df-d9056cdbb137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.768362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-55b84072-b9e2-40a0-84df-d9056cdbb137 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:22.769635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-55b84072-b9e2-40a0-84df-d9056cdbb137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:22.837020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:22.851813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1146/2281] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:22.861905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:22.864111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:22.912961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:22.929222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ee21-4e2e-47e1-9334-043a1944d96a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:22.933413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:22.934195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:22.934576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:22.934947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:22.945055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:22.947169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:22.956677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1136/2282] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:23.182672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455e5c-92cc-45df-945f-8348c04e2f61 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:23.183080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455e5c-92cc-45df-945f-8348c04e2f61 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:23.183681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455e5c-92cc-45df-945f-8348c04e2f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:23.209740 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9b455e5c-92cc-45df-945f-8348c04e2f61 None None] MFA Rules not processed for user `b88d284f57a44ddcb0f1347942a2950b`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:23.211184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9b455e5c-92cc-45df-945f-8348c04e2f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:23.287933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1147/2283] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:25.068933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:25.070393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:25.084788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ab23c-0e15-4db5-84e1-8d2f344d0b77 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:25.091398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:25.092373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:25.092760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:25.093085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] PATH_INFO: `/v3/users/173bf211785f46f2a4cb9120203c4086` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:25.095298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] RBAC: Authorizing `identity:delete_user(user_id=173bf211785f46f2a4cb9120203c4086)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:25.097938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:25.176954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173bf211785f46f2a4cb9120203c4086'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:25.177719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173bf211785f46f2a4cb9120203c4086'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:25.203062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173bf211785f46f2a4cb9120203c4086'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:25.208649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173bf211785f46f2a4cb9120203c4086'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:25.209451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173bf211785f46f2a4cb9120203c4086'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:25.242750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1137/2284] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:25 2022] DELETE /identity/v3/users/173bf211785f46f2a4cb9120203c4086 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:25.247532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:25.248389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:25.248841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:25.282262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:25.283947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:25.366140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1148/2285] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:25.374197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:25.375785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:25.475708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fd21a-5514-4f24-bea9-4800e140650c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:25.479500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:25.480437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:25.480834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:25.481160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:25.499381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:25.505673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:25.524995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1138/2286] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:19:25.993827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:25.995561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:26.008519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf45fa-75cb-4a43-bf4a-583fd90ea136 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:26.013820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:26.014711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:26.014999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:26.015426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] PATH_INFO: `/v3/projects/9fdce18f275642788585a401e7fafbc7` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:26.016678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdce18f275642788585a401e7fafbc7)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:26.018668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:26.119902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdce18f275642788585a401e7fafbc7', 'request_id': 'req-dd743d98-c14e-4c44-8b37-68965cf888d2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.137245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdce18f275642788585a401e7fafbc7', 'request_id': 'req-dd743d98-c14e-4c44-8b37-68965cf888d2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.146059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdce18f275642788585a401e7fafbc7', 'request_id': 'req-dd743d98-c14e-4c44-8b37-68965cf888d2'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.162638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] The token cache is being invalidate because project 9fdce18f275642788585a401e7fafbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:26.163054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.163696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.166188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1149/2287] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:25 2022] DELETE /identity/v3/projects/9fdce18f275642788585a401e7fafbc7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:26.170811 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:26.183820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b791-de63-4b27-910e-7f0386c037d6 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:26.289938 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:26.307698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:26.308643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:26.309303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:26.309303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] PATH_INFO: `/v3/users/10ede9cb751e4981a60648bf26a92299` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:26.310656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ede9cb751e4981a60648bf26a92299)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:26.312730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:26.375397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ede9cb751e4981a60648bf26a92299'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.376318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ede9cb751e4981a60648bf26a92299'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.391321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ede9cb751e4981a60648bf26a92299'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.404639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ede9cb751e4981a60648bf26a92299'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.406096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e6ce7d87-8764-4902-822e-36bae715702e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ede9cb751e4981a60648bf26a92299'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:26.430779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1139/2288] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:26 2022] DELETE /identity/v3/users/10ede9cb751e4981a60648bf26a92299 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:26.923267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:26.924777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:26.958424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd743d98-c14e-4c44-8b37-68965cf888d2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:26.998097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:27.045720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.046715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.047066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.047412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] PATH_INFO: `/v3/projects/d5029ff5d8d94b0096963891e4a145a3` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.048724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5029ff5d8d94b0096963891e4a145a3)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.050816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.116884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5029ff5d8d94b0096963891e4a145a3', 'request_id': 'req-815a4235-8b7c-47a2-83be-003b2ed78d62'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:27.129083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5029ff5d8d94b0096963891e4a145a3', 'request_id': 'req-815a4235-8b7c-47a2-83be-003b2ed78d62'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:27.139126 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5029ff5d8d94b0096963891e4a145a3', 'request_id': 'req-815a4235-8b7c-47a2-83be-003b2ed78d62'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:27.154919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] The token cache is being invalidate because project d5029ff5d8d94b0096963891e4a145a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:27.155334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:27.157391 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-815a4235-8b7c-47a2-83be-003b2ed78d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:27.160364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1150/2289] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:26 2022] DELETE /identity/v3/projects/d5029ff5d8d94b0096963891e4a145a3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:27.165623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.165623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.165879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.197980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:27.199225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:27.317968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1140/2290] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:27.328698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.328993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.329271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.400791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:27.402225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:27.421637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1151/2291] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:27.434079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:27.449958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586523-3e2b-44b3-b09d-e363224eb1c2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:27.455346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.456295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.456829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.457523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.458901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:27.459305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.461135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.479154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1141/2292] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:27.480907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:27.492513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf1ea6-ce02-4b80-9a92-52628ce935b5 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:27.498173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.498977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.499384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.499752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.500924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.502978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.570830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:27.571879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1152/2293] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:27 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:27.583833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6eee0-7ca3-4b93-957d-e79903421927 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:27.687996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.688744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.689028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.689307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.690066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.691987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.702951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:27.728489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1142/2294] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:27 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:27.730195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:27.747976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51199f1-9e36-40dd-b006-a6121c282965 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:27.772801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.773764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.778440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.779363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.780574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.790285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.839371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1153/2295] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:27.841093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:27.854435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d4c2-f493-4ab3-8e87-581db6ed28dd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:27.859537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c3211-cd90-43c1-b58a-037be56c331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.860223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c3211-cd90-43c1-b58a-037be56c331f admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.860509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c3211-cd90-43c1-b58a-037be56c331f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.860819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c3211-cd90-43c1-b58a-037be56c331f admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.861560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c3211-cd90-43c1-b58a-037be56c331f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.863489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c3211-cd90-43c1-b58a-037be56c331f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.881572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1143/2296] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:27.882534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:27.896112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4c2bf-2083-4075-9eed-609fdbe4dd22 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:27.901701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:27.902677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.904806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.905136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] PATH_INFO: `/v3/projects/1e528b43a03d4e4096fdd72192263b45/users/71c27b91d3f74a2f8f988ed39437ec3b/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:27.933409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e528b43a03d4e4096fdd72192263b45, user_id=71c27b91d3f74a2f8f988ed39437ec3b, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:27.936428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:27.957531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1154/2297] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:27 2022] PUT /identity/v3/projects/1e528b43a03d4e4096fdd72192263b45/users/71c27b91d3f74a2f8f988ed39437ec3b/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:27.968636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:27.969459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:27.969778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.002684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] MFA Rules not processed for user `71c27b91d3f74a2f8f988ed39437ec3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:28.003963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:28.111669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1144/2298] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:28.116266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:28.190629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:28.220632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38e4a-7a90-4921-ac75-d9659b42a99c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:28.225657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:28.227123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.227462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.228697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.228846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:28.231795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:28.277931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:28.279098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1155/2299] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:28 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:28.291069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632f686-d3d8-4a51-9f88-4c3e3e1797c0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:28.392897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:28.395008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.395454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.407724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.408522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:28.412479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:28.437971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1145/2300] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:28 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:28.442816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:28.458480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504d59-e499-4f14-bc97-08ce8caa394a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:28.469582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:28.470718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.471250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.471737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.472742 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:28.474525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:28.489671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1156/2301] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:28.494444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:28.507256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89887005-b7c7-441b-afa2-0507bff57150 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:28.521727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:28.522665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.522946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.523223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] PATH_INFO: `/v3/projects/5a6ea0b3db6d49b4adb4dd2ade25152f/users/6bd3284a25644cdeac4e04cde72197b0/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.541366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6ea0b3db6d49b4adb4dd2ade25152f, user_id=6bd3284a25644cdeac4e04cde72197b0, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:28.544354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:28.569653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1146/2302] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:28 2022] PUT /identity/v3/projects/5a6ea0b3db6d49b4adb4dd2ade25152f/users/6bd3284a25644cdeac4e04cde72197b0/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:28.573612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:28.588486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cac5f-6ef1-4399-8bc8-c2b6060a067b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:28.686648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83460-d4bc-4032-a53f-854010dedcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:28.687455 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83460-d4bc-4032-a53f-854010dedcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.687835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83460-d4bc-4032-a53f-854010dedcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.688215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83460-d4bc-4032-a53f-854010dedcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.689310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe83460-d4bc-4032-a53f-854010dedcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:28.691191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe83460-d4bc-4032-a53f-854010dedcd3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:28.702675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1157/2303] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:28.707902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:28.719851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a92c3c-4874-436a-bc49-31d93e2ca007 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:28.733468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:28.734669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.735329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.735754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] PATH_INFO: `/v3/projects/5a6ea0b3db6d49b4adb4dd2ade25152f/users/6bd3284a25644cdeac4e04cde72197b0/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.738254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6ea0b3db6d49b4adb4dd2ade25152f, user_id=6bd3284a25644cdeac4e04cde72197b0, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:28.741401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:28.755890 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1147/2304] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:28 2022] PUT /identity/v3/projects/5a6ea0b3db6d49b4adb4dd2ade25152f/users/6bd3284a25644cdeac4e04cde72197b0/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:28.767029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4678c-6a74-49b0-90f2-1e9ba5711080 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:28.767639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4678c-6a74-49b0-90f2-1e9ba5711080 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:28.767997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4678c-6a74-49b0-90f2-1e9ba5711080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:28.813714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-2ad4678c-6a74-49b0-90f2-1e9ba5711080 None None] MFA Rules not processed for user `6bd3284a25644cdeac4e04cde72197b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:28.822213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2ad4678c-6a74-49b0-90f2-1e9ba5711080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:28.984546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1158/2305] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:28.998107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.001880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:29.056935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:29.101735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35002fed-94bb-4806-9602-8eea5336e695 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.106135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.106779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.106779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.106989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.117693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.118740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.132545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1148/2306] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:29.146905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.147365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.147681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.203581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] MFA Rules not processed for user `63d18c022a19438d88562ef8e8c3fbce`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:29.208415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:29.252785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:29.302421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1159/2307] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:29.307242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.309664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:29.399248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ba05-9282-46dd-8ade-13ed094f4e6d service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.414997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.415770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.416075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.416382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.417279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.419617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.462444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1149/2308] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:29 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:29.466936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.484710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4524e6-4a77-4717-a168-f5da29c238b1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.615634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.616551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.617050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.617486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.618507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.621073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.652041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1160/2309] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:29 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:29.654878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.676800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ec5f1-2904-4cea-81fd-5fe07b23f009 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.687794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.695844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.696524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.696859 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.697152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.698302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.702164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.733116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1150/2310] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:29.736810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.751574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c12a8-02a0-4627-a6fb-197391b11578 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.764850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.767110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.767634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.768288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] PATH_INFO: `/v3/projects/cdac656fd32c44868e4bf1189ef19965/users/b92f89251f814cd881ced9b0646e1faa/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.793931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdac656fd32c44868e4bf1189ef19965, user_id=b92f89251f814cd881ced9b0646e1faa, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.797269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.812182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd1275-b9ad-4e07-89d4-8c9134724cbc admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.822169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1151/2311] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:29 2022] PUT /identity/v3/projects/cdac656fd32c44868e4bf1189ef19965/users/b92f89251f814cd881ced9b0646e1faa/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:29.827212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.893971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd3284a25644cdeac4e04cde72197b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.894726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.895469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.895845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.897316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:29.898313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.899778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.919257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1161/2312] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:29.920471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.933689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6902cbb-b2d6-4979-8955-e419f5f06163 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.942906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8f87-5600-434c-9206-0d803b3470e7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:29.943192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd3284a25644cdeac4e04cde72197b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.944069 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.944514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.945780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.946649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.949066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.949509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:29.950340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:29.950683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:29.953482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:29.954547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:29.963064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:29.965242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:29.987567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1152/2313] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:29.991517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:29.999259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1162/2314] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:29 2022] POST /identity/v3/projects => generated 353 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:30.000269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:30.015398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c30c43-36f5-4c15-9d3e-dda56efe72ef admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:30.041061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:30.129990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:30.130919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:30.131197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:30.131475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] PATH_INFO: `/v3/projects/cdac656fd32c44868e4bf1189ef19965/users/b92f89251f814cd881ced9b0646e1faa/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:30.134299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdac656fd32c44868e4bf1189ef19965, user_id=b92f89251f814cd881ced9b0646e1faa, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:30.138721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:30.155432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1153/2315] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:29 2022] PUT /identity/v3/projects/cdac656fd32c44868e4bf1189ef19965/users/b92f89251f814cd881ced9b0646e1faa/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:30.158485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079770ee-2417-4383-a3f3-e9afc24e4bb5 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:30.232733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd3284a25644cdeac4e04cde72197b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:30.234327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:30.234828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:30.235473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:30.237077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:30.237769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:30.240882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:30.257741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1163/2316] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:30.306611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:30.319823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e42bd-24ae-4a7e-8dbd-13c04f398669 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:30.325803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd3284a25644cdeac4e04cde72197b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:30.327373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:30.327373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:30.327701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] PATH_INFO: `/v3/projects/49344ff0df3645d2b907332e32ec9c9a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:30.330250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49344ff0df3645d2b907332e32ec9c9a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:30.332495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:30.390913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49344ff0df3645d2b907332e32ec9c9a', 'request_id': 'req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:30.398322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49344ff0df3645d2b907332e32ec9c9a', 'request_id': 'req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:30.408066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49344ff0df3645d2b907332e32ec9c9a', 'request_id': 'req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:30.420060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] The token cache is being invalidate because project 49344ff0df3645d2b907332e32ec9c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:30.420875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:30.425117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cfa92ec7-aef0-430f-ab8a-9f7cea91dd94 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:30.427044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1154/2317] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:30 2022] DELETE /identity/v3/projects/49344ff0df3645d2b907332e32ec9c9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:30.733481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:30.735807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:30.958786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7467f7-00a4-4d26-9073-1f627d9ae2c0 tempest-VolumeQuotaClassesTest-864554657 tempest-VolumeQuotaClassesTest-864554657-project-admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:31.079832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:31.219927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:31.220903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:31.221193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:31.221474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] PATH_INFO: `/v3/users/71c27b91d3f74a2f8f988ed39437ec3b` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:31.229596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c27b91d3f74a2f8f988ed39437ec3b)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:31.238721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:31.377934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c27b91d3f74a2f8f988ed39437ec3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:31.406601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c27b91d3f74a2f8f988ed39437ec3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:31.436073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c27b91d3f74a2f8f988ed39437ec3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:31.436924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c27b91d3f74a2f8f988ed39437ec3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:31.452573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c27b91d3f74a2f8f988ed39437ec3b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:31.463747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1164/2318] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:30 2022] DELETE /identity/v3/users/71c27b91d3f74a2f8f988ed39437ec3b => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:31.468565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:31.469566 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:31.470050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:31.495722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:31.498842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:31.618334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1155/2319] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:31.653388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:31.657639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:31.792880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115309b-8e86-4166-acf3-cef8322068fd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:31.818268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:31.819123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:31.819489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:31.819842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:31.845713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:31.847302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:31.865148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1165/2320] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:19:32.601532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:32.603627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:32.622181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c2c70-aaab-48c0-bb79-9b03fa1e050a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:32.628749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:32.629650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:32.629942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:32.630227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] PATH_INFO: `/v3/projects/1e528b43a03d4e4096fdd72192263b45` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:32.632037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e528b43a03d4e4096fdd72192263b45)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:32.634934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:32.694510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:32.715399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e528b43a03d4e4096fdd72192263b45', 'request_id': 'req-21b62d76-0082-49ca-aec6-595de2b3793f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:32.727931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e528b43a03d4e4096fdd72192263b45', 'request_id': 'req-21b62d76-0082-49ca-aec6-595de2b3793f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:32.742979 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e528b43a03d4e4096fdd72192263b45', 'request_id': 'req-21b62d76-0082-49ca-aec6-595de2b3793f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:32.756679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] The token cache is being invalidate because project 1e528b43a03d4e4096fdd72192263b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:32.757232 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:32.758354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:32.760769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1156/2321] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:32 2022] DELETE /identity/v3/projects/1e528b43a03d4e4096fdd72192263b45 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:32.765030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:32.777065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a811446-2953-4bfe-b8af-1282ef823370 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:32.874374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:32.887767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:32.889898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:32.890223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:32.890681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] PATH_INFO: `/v3/users/6bd3284a25644cdeac4e04cde72197b0` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:32.893465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd3284a25644cdeac4e04cde72197b0)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:32.897509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:32.990507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd3284a25644cdeac4e04cde72197b0'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.001097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd3284a25644cdeac4e04cde72197b0'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.023343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd3284a25644cdeac4e04cde72197b0'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.027983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd3284a25644cdeac4e04cde72197b0'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.038340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c20bc0ae-7ae3-40ad-bb56-ebea99072001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd3284a25644cdeac4e04cde72197b0'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.047272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1166/2322] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:32 2022] DELETE /identity/v3/users/6bd3284a25644cdeac4e04cde72197b0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:33.595187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:33.596998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:33.620568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b62d76-0082-49ca-aec6-595de2b3793f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:33.746467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:33.748026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:33.748523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:33.749124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] PATH_INFO: `/v3/projects/5a6ea0b3db6d49b4adb4dd2ade25152f` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:33.752691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6ea0b3db6d49b4adb4dd2ade25152f)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:33.755948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:33.875740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'request_id': 'req-21c02e61-9451-4920-b10f-5c50db243f4e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.889302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'request_id': 'req-21c02e61-9451-4920-b10f-5c50db243f4e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.908275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6ea0b3db6d49b4adb4dd2ade25152f', 'request_id': 'req-21c02e61-9451-4920-b10f-5c50db243f4e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.935795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] The token cache is being invalidate because project 5a6ea0b3db6d49b4adb4dd2ade25152f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:33.936223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.937344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:33.939405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1157/2323] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:33 2022] DELETE /identity/v3/projects/5a6ea0b3db6d49b4adb4dd2ade25152f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:33.947481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a41b-dfa0-4f43-802f-d3a2a00b2b7f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:33.948323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a41b-dfa0-4f43-802f-d3a2a00b2b7f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:33.948847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a41b-dfa0-4f43-802f-d3a2a00b2b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:33.973142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f6a6a41b-dfa0-4f43-802f-d3a2a00b2b7f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:33.974481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f6a6a41b-dfa0-4f43-802f-d3a2a00b2b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:34.073819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.075471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:34.140826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1167/2324] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:34.150525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.151499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.151897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.231467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:34.233286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:34.240820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:34.265918 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1168/2325] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:34.271033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.293019 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263694-a6dd-4538-bbb4-f3853cb02258 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.302826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c02e61-9451-4920-b10f-5c50db243f4e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.320756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.321650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.322234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.322369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.322633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.322917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] PATH_INFO: `/v3/users/4f6d2f3b90154af1abd3be4803883d15` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.323212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.324635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.325603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:34.326650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.329480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6d2f3b90154af1abd3be4803883d15)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.329628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.331625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.370040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1169/2326] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:34.371637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.394298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5df6a5-9ebd-4f56-b2e0-e0244ea10547 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.411519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.413027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.416945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.417544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.418585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.420884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.458081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6d2f3b90154af1abd3be4803883d15'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:34.458810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6d2f3b90154af1abd3be4803883d15'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:34.475917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6d2f3b90154af1abd3be4803883d15'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:34.478052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1170/2327] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:34 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:34.489344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.498857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6d2f3b90154af1abd3be4803883d15'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:34.499611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-78fd1f27-de7b-4050-a610-843482909c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6d2f3b90154af1abd3be4803883d15'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:34.527186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1158/2328] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:34 2022] DELETE /identity/v3/users/4f6d2f3b90154af1abd3be4803883d15 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:34.532613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.532922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.533203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.559690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:34.576206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:34.578983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:34.624383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d2a73-caa2-4b3c-aeb4-0c3424583000 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.712843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1159/2329] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:34.717195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.718284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.718582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.718873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.719517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.719629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.721171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:34.721758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.755922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1171/2330] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:34 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:34.757913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.759767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:34.777307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b197cc-72d7-413b-a754-cd5244f30e10 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.782887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.788720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.788720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.788720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.788720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.788720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.809109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1172/2331] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:34.811727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.823654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744b71-ac5a-46fa-b690-54578b8cceaf admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.835053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.836369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.836696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.836946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945da42d-b00f-4908-96f4-1f0282ebaa1b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.837065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.837817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.839416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.845775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de872a4b-64f7-4a12-9df0-b3a9cdcc9f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.846630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de872a4b-64f7-4a12-9df0-b3a9cdcc9f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.847028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de872a4b-64f7-4a12-9df0-b3a9cdcc9f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.847509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de872a4b-64f7-4a12-9df0-b3a9cdcc9f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.853932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1173/2332] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:34.857923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:34.864423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de872a4b-64f7-4a12-9df0-b3a9cdcc9f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.866136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de872a4b-64f7-4a12-9df0-b3a9cdcc9f96 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.880001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1160/2333] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:34.896756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f0e63-e999-4675-b70b-fa04d79ed72d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:34.910298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:34.911249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:34.912227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:34.912760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] PATH_INFO: `/v3/projects/ec3223d3f6164bdea1635f3655debac2/users/a2e96be97d9247d5919e5fc322768b35/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:34.951066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3223d3f6164bdea1635f3655debac2, user_id=a2e96be97d9247d5919e5fc322768b35, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:34.954774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:34.982342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1174/2334] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:34 2022] PUT /identity/v3/projects/ec3223d3f6164bdea1635f3655debac2/users/a2e96be97d9247d5919e5fc322768b35/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:35.002164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:35.003033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:35.003749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:35.059355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:35.109045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] MFA Rules not processed for user `a2e96be97d9247d5919e5fc322768b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:35.113579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:35.248334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1161/2335] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:35.248989 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:35.367370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d778-9123-4742-b0d0-eb2f121e36b8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:35.392427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:35.393128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:35.393421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:35.393701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:35.395427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:35.398464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:35.405184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:35.406908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:35.433487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec933e7d-6a4b-4b28-b2ee-e0898fb1e174 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:35.453387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:35.454308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:35.454629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:35.454862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] PATH_INFO: `/v3/projects/cec3facfcffa44b8b3ce6971860ae957` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:35.457384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec3facfcffa44b8b3ce6971860ae957)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:35.459372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:35.494972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1175/2336] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:35 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:35.495933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:35.539609 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:35.572768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec3facfcffa44b8b3ce6971860ae957', 'request_id': 'req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.587754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec3facfcffa44b8b3ce6971860ae957', 'request_id': 'req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.609230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec3facfcffa44b8b3ce6971860ae957', 'request_id': 'req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.633246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] The token cache is being invalidate because project cec3facfcffa44b8b3ce6971860ae957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:35.634848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.636178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.641283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1162/2337] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:35 2022] DELETE /identity/v3/projects/cec3facfcffa44b8b3ce6971860ae957 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:35.645230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:35.646947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:35.680198 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90817b76-f485-489f-a44d-794244e4b9c8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:35.838371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5bcd-cae8-4aca-af37-caa0bbd1144d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:35.848290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:35.849224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:35.850146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:35.851136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:35.851627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:35.851994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:35.852377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:35.853220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:35.853598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] PATH_INFO: `/v3/users/7facb8cf4e7a4a389565b1a8bc0b1174` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:35.856327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:35.857456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7facb8cf4e7a4a389565b1a8bc0b1174)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:35.859574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:35.917785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1176/2338] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:35 2022] POST /identity/v3/users => generated 297 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:35.921953 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:35.926982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:35.928843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:35.974478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d7d1e-f432-4dfb-a13b-7eb519234def admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:35.996643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:35.997958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7facb8cf4e7a4a389565b1a8bc0b1174'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.998200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:35.998613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:35.999392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7facb8cf4e7a4a389565b1a8bc0b1174'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:35.999895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.003067 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:36.009581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:36.039111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7facb8cf4e7a4a389565b1a8bc0b1174'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.046577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1177/2339] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:36.050418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:36.053780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7facb8cf4e7a4a389565b1a8bc0b1174'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.054762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7facb8cf4e7a4a389565b1a8bc0b1174'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.063272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133322d-4af8-4935-a5b9-357629715c7e admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:36.070452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:36.071723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:36.072191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:36.072693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] PATH_INFO: `/v3/projects/e95532f847b14e64815cd3225dc8986f/users/1cc9b3bd4ed5437da526dacc36142a62/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.077067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1163/2340] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:35 2022] DELETE /identity/v3/users/7facb8cf4e7a4a389565b1a8bc0b1174 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:36.120161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95532f847b14e64815cd3225dc8986f, user_id=1cc9b3bd4ed5437da526dacc36142a62, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:36.125732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:36.160655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1178/2341] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:36 2022] PUT /identity/v3/projects/e95532f847b14e64815cd3225dc8986f/users/1cc9b3bd4ed5437da526dacc36142a62/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:36.164763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:36.166622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:36.350698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7565d-00d6-4545-8aed-dfdf0ab685c1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:36.502551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:36.503407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:36.503794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:36.504198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.505118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:36.507173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:36.521075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1164/2342] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:36.525454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:36.541933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f122505-4a59-41a4-8dc0-667f1dee7a4b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:36.555543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:36.555940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074d3d-c56f-4441-8f8d-e9c4a5f2f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:36.556901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074d3d-c56f-4441-8f8d-e9c4a5f2f6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:36.557182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074d3d-c56f-4441-8f8d-e9c4a5f2f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:36.557457 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074d3d-c56f-4441-8f8d-e9c4a5f2f6a5 admin admin] PATH_INFO: `/v3/projects/e95532f847b14e64815cd3225dc8986f/users/1cc9b3bd4ed5437da526dacc36142a62/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.557982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:36.565347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50074d3d-c56f-4441-8f8d-e9c4a5f2f6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95532f847b14e64815cd3225dc8986f, user_id=1cc9b3bd4ed5437da526dacc36142a62, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:36.568205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50074d3d-c56f-4441-8f8d-e9c4a5f2f6a5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:36.590145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1179/2343] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:36 2022] PUT /identity/v3/projects/e95532f847b14e64815cd3225dc8986f/users/1cc9b3bd4ed5437da526dacc36142a62/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:36.600883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:36.601169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:36.601454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.610673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55ac4e-c7c4-4441-afb3-2e97e78355fc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:36.653072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] MFA Rules not processed for user `1cc9b3bd4ed5437da526dacc36142a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:36.654374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:36.666165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:36.703042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:36.704178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:36.704481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:36.704891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] PATH_INFO: `/v3/projects/2eb24cae483a468a83cfaeadd85e3256` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.706950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb24cae483a468a83cfaeadd85e3256)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:36.708641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:36.742808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:36.806154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1180/2344] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:36.819082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:36.821142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:36.844841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb24cae483a468a83cfaeadd85e3256', 'request_id': 'req-61283068-6f03-425d-b950-9cf0eb2f9966'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.860268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb24cae483a468a83cfaeadd85e3256', 'request_id': 'req-61283068-6f03-425d-b950-9cf0eb2f9966'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.879983 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb24cae483a468a83cfaeadd85e3256', 'request_id': 'req-61283068-6f03-425d-b950-9cf0eb2f9966'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.898939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] The token cache is being invalidate because project 2eb24cae483a468a83cfaeadd85e3256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:36.899498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.902581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-61283068-6f03-425d-b950-9cf0eb2f9966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:36.904802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1165/2345] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:36 2022] DELETE /identity/v3/projects/2eb24cae483a468a83cfaeadd85e3256 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:36.909795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ca7a-4f95-43a9-854c-b287a4d4527d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:36.910093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ca7a-4f95-43a9-854c-b287a4d4527d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:36.910379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ca7a-4f95-43a9-854c-b287a4d4527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:36.930985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2042-9bd8-4c7e-94e4-436b3567d66f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:36.933391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4a09ca7a-4f95-43a9-854c-b287a4d4527d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:36.935079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4a09ca7a-4f95-43a9-854c-b287a4d4527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:37.017477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1166/2346] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:37.025764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.025989 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.026105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.035179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.035986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.036611 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.037179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.042531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:37.053447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:37.056738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:37.071028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1167/2347] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:37.072235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.086228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74d8f-a7dc-4b38-8026-8b8b5e492439 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.095768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.096805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.097144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.097514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.098614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:37.099026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.101829 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.153085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1168/2348] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:37.158557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.170656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24b831-9ea6-4bfa-b4f1-6234c4f4d8b4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.182284 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.185442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.191271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.192391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.192391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.192623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.193482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.195426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.208949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1181/2349] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:37.279124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1169/2350] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:37 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:37.280190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.298084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f8148-bdac-47a9-986f-72c35c7b6391 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.372217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.374216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:37.376312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:37.392791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.393581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.393870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.394724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.394977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.397441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.430073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1182/2351] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:37 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:37.434362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.453983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a86a-a874-4699-abeb-61af1d890d82 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.456756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:37.463315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.464107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.464459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.464825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.465755 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.467712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.480536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1183/2352] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:37.484472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.519739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d372-02c3-49b6-b281-9d1505d140d8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.530632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.531781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.532161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.532532 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.533724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.534955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53156557-3e4a-479e-9c53-f05c3b83c2d7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.536866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.545472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.546464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.546905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.547329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.558209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:37.565493 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1184/2353] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:37.566417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.583403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2e4f-cf34-4e0e-b2d5-80afc1341acb admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:37.594013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81beffe-be41-486d-aa13-afa473091e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:37.595237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81beffe-be41-486d-aa13-afa473091e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.595808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81beffe-be41-486d-aa13-afa473091e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.596098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81beffe-be41-486d-aa13-afa473091e3d admin admin] PATH_INFO: `/v3/projects/2ee8dee376d045d6be89790993f7a248/users/1557ff6c1f2d4acb84cac4a6dce1678c/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.619508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81beffe-be41-486d-aa13-afa473091e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee8dee376d045d6be89790993f7a248, user_id=1557ff6c1f2d4acb84cac4a6dce1678c, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.623580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81beffe-be41-486d-aa13-afa473091e3d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.657342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1185/2354] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:37 2022] PUT /identity/v3/projects/2ee8dee376d045d6be89790993f7a248/users/1557ff6c1f2d4acb84cac4a6dce1678c/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:37.670758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:37.671059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:37.671342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:37.678306 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:37.680186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:37.692092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1170/2355] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:37.739328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] MFA Rules not processed for user `1557ff6c1f2d4acb84cac4a6dce1678c`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:37.741105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:37.900595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1186/2356] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:37.900821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:37.924853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3f2d-fa04-4b14-9366-60319f28dd27 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.062019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.062926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.063461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.063884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.064905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.067138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.112168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1171/2357] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:37 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:38.116763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.137379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363002-ce9f-4211-b0d1-7973b378f8af None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.236794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.237963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.238416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.238974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.240757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.243772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.299344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.299782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1187/2358] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:38 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:38.327695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47d20-f9ad-4e12-a105-2090a995d2e0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.339881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.340814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.341397 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.341771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.342664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.344374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.366677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1172/2359] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:38.368266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.394792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9563ae-c3c2-4edf-b21a-ee89d29e5d79 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.404129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e852e9-983c-4e34-a843-03c126fb5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.405260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e852e9-983c-4e34-a843-03c126fb5907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.405632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e852e9-983c-4e34-a843-03c126fb5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.406768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e852e9-983c-4e34-a843-03c126fb5907 admin admin] PATH_INFO: `/v3/projects/aee3b753db8e44bd965532851bed39be/users/ed43b0536d15409b96f0511635cbadce/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.418512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:38.429673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e852e9-983c-4e34-a843-03c126fb5907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee3b753db8e44bd965532851bed39be, user_id=ed43b0536d15409b96f0511635cbadce, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.432653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e852e9-983c-4e34-a843-03c126fb5907 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.447054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1188/2360] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:38 2022] PUT /identity/v3/projects/aee3b753db8e44bd965532851bed39be/users/ed43b0536d15409b96f0511635cbadce/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:38.451645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.467467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4ac6a-171e-4131-bfcf-6e341237add9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.500107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.500401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.502622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.543679 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.544463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.544853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.545333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.547154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] MFA Rules not processed for user `b92f89251f814cd881ced9b0646e1faa`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:38.547263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.547954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:38.548240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.550067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:38.561667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1173/2361] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:38.566773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.578195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39bda-7f43-47a1-b3a7-71b570024d11 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.583144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd56977-a64f-449d-b759-9e825f557312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.584105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd56977-a64f-449d-b759-9e825f557312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.584395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd56977-a64f-449d-b759-9e825f557312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.584700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd56977-a64f-449d-b759-9e825f557312 admin admin] PATH_INFO: `/v3/projects/aee3b753db8e44bd965532851bed39be/users/ed43b0536d15409b96f0511635cbadce/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.592337 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd56977-a64f-449d-b759-9e825f557312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee3b753db8e44bd965532851bed39be, user_id=ed43b0536d15409b96f0511635cbadce, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.595294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd56977-a64f-449d-b759-9e825f557312 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.621043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1174/2362] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:38 2022] PUT /identity/v3/projects/aee3b753db8e44bd965532851bed39be/users/ed43b0536d15409b96f0511635cbadce/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:38.622783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.623251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.623803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.667490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1189/2363] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:38.677623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.679749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:38.683248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] MFA Rules not processed for user `ed43b0536d15409b96f0511635cbadce`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:38.684724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:38.763984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d760-c6f1-468b-ac4c-e1c8cdc3997f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.780027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1175/2364] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:38.806856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:38.808332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:38.844807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.845763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.846191 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.846475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.848545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:38.876401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fcf0c-63b3-4f74-9d62-7b7112290dd9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:38.880862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:38.881748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:38.882198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:38.882635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:38.893461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.894926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.902403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:38.907356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1176/2365] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:38.930278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:38.932046 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732415b5-c1bd-41a3-b167-d30bd8621a46 service glance] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:38.942752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1190/2366] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:19:38.950564 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:39.069004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a67d8-9ca7-43e7-a87b-0babd64e832d service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:39.074625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:39.075704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:39.075993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:39.076326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] PATH_INFO: `/v3/users/1557ff6c1f2d4acb84cac4a6dce1678c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:39.086024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1557ff6c1f2d4acb84cac4a6dce1678c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:39.088284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:39.107785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:39.157661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1557ff6c1f2d4acb84cac4a6dce1678c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:39.158340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1557ff6c1f2d4acb84cac4a6dce1678c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:39.161266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:39.161913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:39.162285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:39.172320 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1557ff6c1f2d4acb84cac4a6dce1678c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:39.183599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1557ff6c1f2d4acb84cac4a6dce1678c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:39.183984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-db5946f7-7c1e-44e9-bca9-60380ab675c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1557ff6c1f2d4acb84cac4a6dce1678c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:39.189441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:39.192963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:39.199177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1177/2367] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:38 2022] DELETE /identity/v3/users/1557ff6c1f2d4acb84cac4a6dce1678c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:39.203934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:39.204444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:39.205505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:39.236540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:39.237783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:39.253944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1191/2368] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:19:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:39.301806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:39.303171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:39.309301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1178/2369] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:39.316496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:39.317946 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:39.385103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a82af-6463-4cda-8c77-ad9fe03cbaca None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:39.395787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:39.402596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:39.402596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:39.402596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:39.405502 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbadea-d12a-49e9-a996-80a963ebfc2f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:39.413557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:39.415343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:39.433165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1179/2370] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:39.506233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:39.506971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:39.507262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:39.507583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:39.547728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:39.592836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:39.594676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:39.605077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1192/2371] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:19:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:19:39.861492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:39.865407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:39.892342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448a14-f5da-4879-99dc-a9bd50b9aebd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:39.904754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:39.905683 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:39.905976 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:39.906265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] PATH_INFO: `/v3/projects/2ee8dee376d045d6be89790993f7a248` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:39.908373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee8dee376d045d6be89790993f7a248)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:39.928688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:40.048833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:40.071042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee8dee376d045d6be89790993f7a248', 'request_id': 'req-a8d6a621-e848-4925-b821-c9a2fe67db74'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.078114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee8dee376d045d6be89790993f7a248', 'request_id': 'req-a8d6a621-e848-4925-b821-c9a2fe67db74'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.098607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee8dee376d045d6be89790993f7a248', 'request_id': 'req-a8d6a621-e848-4925-b821-c9a2fe67db74'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.137237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] The token cache is being invalidate because project 2ee8dee376d045d6be89790993f7a248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:40.137485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.141043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a8d6a621-e848-4925-b821-c9a2fe67db74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.147996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1180/2372] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:39 2022] DELETE /identity/v3/projects/2ee8dee376d045d6be89790993f7a248 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:40.151982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:40.168091 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b3f8-a1e2-4c20-8df2-f39af1cec2a3 service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:40.293789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:40.295787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:40.296428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:40.297151 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] PATH_INFO: `/v3/users/ed43b0536d15409b96f0511635cbadce` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:40.302203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed43b0536d15409b96f0511635cbadce)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:40.304558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:40.317015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:40.317328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:40.317629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:40.352824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] MFA Rules not processed for user `dc9c9dd337834dea821cc4ea6ecc10a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:40.355240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:40.398243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed43b0536d15409b96f0511635cbadce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.417971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed43b0536d15409b96f0511635cbadce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.451632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed43b0536d15409b96f0511635cbadce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.460492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed43b0536d15409b96f0511635cbadce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.484544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed43b0536d15409b96f0511635cbadce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:40.495672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1193/2373] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:40 2022] DELETE /identity/v3/users/ed43b0536d15409b96f0511635cbadce => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:40.505728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1181/2374] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:40.632203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:40.633696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:40.806189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:40.838842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f654-c951-4215-801b-83673404acd9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:40.865201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:40.866463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:40.870329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:40.870884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] PATH_INFO: `/v3/users/a2e96be97d9247d5919e5fc322768b35` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:40.873767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e96be97d9247d5919e5fc322768b35)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:40.884838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:41.051303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e96be97d9247d5919e5fc322768b35'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.065852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e96be97d9247d5919e5fc322768b35'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.105345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e96be97d9247d5919e5fc322768b35'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.108356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e96be97d9247d5919e5fc322768b35'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.130897 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1a9a1a0b-b1fb-4c74-a297-bcfd58bb643f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e96be97d9247d5919e5fc322768b35'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.132043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:41.135540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:41.158832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1194/2375] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:40 2022] DELETE /identity/v3/users/a2e96be97d9247d5919e5fc322768b35 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:41.162982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:41.163280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:41.163564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:41.187587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebc3b5-5de8-48da-80e7-96cdfdc34aef None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:41.209558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:41.211513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:41.337513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:41.338578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:41.338889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:41.339148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] PATH_INFO: `/v3/projects/aee3b753db8e44bd965532851bed39be` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:41.340571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee3b753db8e44bd965532851bed39be)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:41.345098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:41.345606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1195/2376] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:41.380023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:41.385793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:41.481234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee3b753db8e44bd965532851bed39be', 'request_id': 'req-1282ba93-1245-47c2-ba59-3d5f53f6ff65'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.486114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1459-a773-4236-a092-f03964b2f2a3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:41.494403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee3b753db8e44bd965532851bed39be', 'request_id': 'req-1282ba93-1245-47c2-ba59-3d5f53f6ff65'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.508640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee3b753db8e44bd965532851bed39be', 'request_id': 'req-1282ba93-1245-47c2-ba59-3d5f53f6ff65'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.511288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:41.532117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] The token cache is being invalidate because project aee3b753db8e44bd965532851bed39be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:41.536171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.538793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1282ba93-1245-47c2-ba59-3d5f53f6ff65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:41.548672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1182/2377] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:41 2022] DELETE /identity/v3/projects/aee3b753db8e44bd965532851bed39be => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:41.553436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c767-3bbf-4c0f-a6b4-4b047d13f0e4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:41.553757 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c767-3bbf-4c0f-a6b4-4b047d13f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:41.554047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c767-3bbf-4c0f-a6b4-4b047d13f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:41.556219 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:41.597370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7a25c767-3bbf-4c0f-a6b4-4b047d13f0e4 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:41.598634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7a25c767-3bbf-4c0f-a6b4-4b047d13f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:41.640974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:41.641666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:41.641969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:41.642977 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:41.647822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:41.800720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1183/2378] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:41.802771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:41.803365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:41.803732 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:41.868708 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:41.871130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:41.884175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1184/2379] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:41.891060 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:41.891414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:41.892633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:41.929365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944aa3a-8969-42fa-b047-5122dcd398cd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:41.929876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1196/2380] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:19:41.948496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:41.949458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:41.949904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:41.950331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:41.951468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:41.952646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:41.956782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:41.989421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1185/2381] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:41.989854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.008309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c4eeb-6052-4a76-a2af-58b34861f815 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.030188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.030899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.031187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.031470 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.032200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.035123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:42.145168 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1197/2382] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:42.148146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.171753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b453f-e22c-405b-a960-02c3959d51cb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.278083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.279365 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.279817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.281071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.282264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.286868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:42.352734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1186/2383] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:42 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:42.353036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.362676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3b26-17cd-45f1-98e0-91d954ba600f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.386351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.387053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.387347 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.387629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.388849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.390685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:42.411716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1198/2384] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:42.412788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.427894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488dac7-3715-4aca-985c-42c512533886 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.439598 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.440304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.440594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.440898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.441658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.456553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:42.483555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1187/2385] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:42.484302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.510677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7baaf1-93f3-4b2d-8de7-c07b9c8f9829 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.525413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8e88-a7eb-4b06-a325-a652a985701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.528045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8e88-a7eb-4b06-a325-a652a985701e admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.528045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8e88-a7eb-4b06-a325-a652a985701e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.528045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8e88-a7eb-4b06-a325-a652a985701e admin admin] PATH_INFO: `/v3/projects/46c9666b35754ebaa73b424bd2192975/users/ec3246173d424db2bc80e30fa5ca3744/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.569024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.569227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8e88-a7eb-4b06-a325-a652a985701e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c9666b35754ebaa73b424bd2192975, user_id=ec3246173d424db2bc80e30fa5ca3744, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.573851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:42.586205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8e88-a7eb-4b06-a325-a652a985701e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:42.617315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f572-3c3b-4eec-a9fd-23f999808b59 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.630573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1199/2386] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:42 2022] PUT /identity/v3/projects/46c9666b35754ebaa73b424bd2192975/users/ec3246173d424db2bc80e30fa5ca3744/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:42.642524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.642906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.643227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.774700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] MFA Rules not processed for user `ec3246173d424db2bc80e30fa5ca3744`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:42.777787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:42.848924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:42.870136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.871646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.873078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.873541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] PATH_INFO: `/v3/projects/ec3223d3f6164bdea1635f3655debac2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.878194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3223d3f6164bdea1635f3655debac2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.880484 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:42.943537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1200/2387] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:42.945507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:42.969794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e935d-c34c-4e99-9538-0a30af51ecc2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:42.985326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:42.986144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:42.986552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:42.986994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:42.988031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:42.990205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:43.009108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:43.109836 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3223d3f6164bdea1635f3655debac2', 'request_id': 'req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.144217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1201/2388] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:42 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:43.148483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:43.186049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3223d3f6164bdea1635f3655debac2', 'request_id': 'req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.216876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3223d3f6164bdea1635f3655debac2', 'request_id': 'req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.256902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] The token cache is being invalidate because project ec3223d3f6164bdea1635f3655debac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:43.258678 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.261198 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.278348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1188/2389] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:42 2022] DELETE /identity/v3/projects/ec3223d3f6164bdea1635f3655debac2 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:43.282778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:43.290866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:43.427516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4d25-f126-426a-bb98-31b934e9ac1c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:43.435554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:43.436840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:43.437422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:43.437990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:43.439182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:43.451691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:43.510407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1202/2390] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:43 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:43.511652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:43.515172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b9bf8-a100-4277-ab2e-f715fe6a7e7d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:43.516807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:43.529794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:43.531937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:43.532378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:43.532707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] PATH_INFO: `/v3/users/1cc9b3bd4ed5437da526dacc36142a62` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:43.536301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc9b3bd4ed5437da526dacc36142a62)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:43.541962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:43.544131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840473-bdb2-4b7a-bb06-42ce1dab8c84 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:43.557027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:43.557872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:43.558342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:43.558780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:43.559741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:43.564841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:43.613386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1203/2391] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:43.616557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:43.664188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea584c69-1f78-4ae3-8fc8-486931088d6d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:43.677378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc9b3bd4ed5437da526dacc36142a62'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.678262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc9b3bd4ed5437da526dacc36142a62'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.688923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:43.692153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:43.692940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc9b3bd4ed5437da526dacc36142a62'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.694614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:43.696866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:43.699350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:43.705518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc9b3bd4ed5437da526dacc36142a62'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.706375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:43.706546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc9b3bd4ed5437da526dacc36142a62'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:43.720958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:43.741009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1204/2393] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:43.745621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:43.753673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:43.758935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1189/2393] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:43 2022] DELETE /identity/v3/users/1cc9b3bd4ed5437da526dacc36142a62 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:43.783595 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc192e-2b36-46f2-baeb-210349eb7414 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:43.888747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:43.890199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:43.954957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9ea2-3bf8-41ef-ae56-973467790dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:43.958244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9ea2-3bf8-41ef-ae56-973467790dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:43.958999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9ea2-3bf8-41ef-ae56-973467790dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:43.958999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9ea2-3bf8-41ef-ae56-973467790dd2 admin admin] PATH_INFO: `/v3/projects/0d1b56c641ab4a8fbccd7468087cb24c/users/d79d4e5948db427da4f28cbd19fe852a/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:43.983173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f9ea2-3bf8-41ef-ae56-973467790dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1b56c641ab4a8fbccd7468087cb24c, user_id=d79d4e5948db427da4f28cbd19fe852a, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:43.985959 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f9ea2-3bf8-41ef-ae56-973467790dd2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:44.033878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1205/2394] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:43 2022] PUT /identity/v3/projects/0d1b56c641ab4a8fbccd7468087cb24c/users/d79d4e5948db427da4f28cbd19fe852a/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:44.044687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.045627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.046111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.082595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb391-43d2-473c-ac72-5a0a449563b5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:44.125917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] MFA Rules not processed for user `d79d4e5948db427da4f28cbd19fe852a`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:44.128093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.160278 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:44.161235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.161519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.161796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] PATH_INFO: `/v3/users/91e67292eb0e4db183962dfe3719d2df` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.163184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e67292eb0e4db183962dfe3719d2df)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:44.165787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:44.184099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:44.259482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e67292eb0e4db183962dfe3719d2df'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.260502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e67292eb0e4db183962dfe3719d2df'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.280990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1206/2395] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:44.288159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:44.291773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e67292eb0e4db183962dfe3719d2df'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.311962 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e67292eb0e4db183962dfe3719d2df'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.313116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e67292eb0e4db183962dfe3719d2df'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.333988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1190/2396] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:43 2022] DELETE /identity/v3/users/91e67292eb0e4db183962dfe3719d2df => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:44.334395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd900d00-7f05-4065-8740-41e30d8130c4 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:44.334860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:44.338761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.429719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:44.488196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be553bb5-e27a-4d9f-a053-bda2622303c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:44.489070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553bb5-e27a-4d9f-a053-bda2622303c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.489462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553bb5-e27a-4d9f-a053-bda2622303c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.489860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553bb5-e27a-4d9f-a053-bda2622303c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.490677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553bb5-e27a-4d9f-a053-bda2622303c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:44.492793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553bb5-e27a-4d9f-a053-bda2622303c8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:44.535478 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b283-ae6f-477d-8950-ebff255f3d89 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:44.550985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:44.551902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.552184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.552462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] PATH_INFO: `/v3/projects/e95532f847b14e64815cd3225dc8986f` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.552911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1207/2397] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:44 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:44.554356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.554801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.555204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.557312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95532f847b14e64815cd3225dc8986f)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:44.560205 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:44.578573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:44.580555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.679377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95532f847b14e64815cd3225dc8986f', 'request_id': 'req-9e15c078-7a3c-4370-b9be-14d9908b24b9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.688935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95532f847b14e64815cd3225dc8986f', 'request_id': 'req-9e15c078-7a3c-4370-b9be-14d9908b24b9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.704302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95532f847b14e64815cd3225dc8986f', 'request_id': 'req-9e15c078-7a3c-4370-b9be-14d9908b24b9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.710365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1208/2398] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:44.711533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:44.717519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.731302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bedaa-b97a-47c5-a1c4-210fc5f6bd4e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:44.732746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] The token cache is being invalidate because project e95532f847b14e64815cd3225dc8986f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:44.733245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.734196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:44.736619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1191/2399] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:44 2022] DELETE /identity/v3/projects/e95532f847b14e64815cd3225dc8986f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:44.741250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:44.743167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.798982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:44.809530 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54955-484c-4978-865c-30cb5a7a6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:44.810809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54955-484c-4978-865c-30cb5a7a6918 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.811143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54955-484c-4978-865c-30cb5a7a6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.811600 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54955-484c-4978-865c-30cb5a7a6918 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.813233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def54955-484c-4978-865c-30cb5a7a6918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:44.814961 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def54955-484c-4978-865c-30cb5a7a6918 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:44.853557 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1209/2400] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:44 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:44.855132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.857246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.858486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.869842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15c078-7a3c-4370-b9be-14d9908b24b9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:44.884393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:44.885188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.888524 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.889154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:44.894343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.897738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:44.901797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.939187 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:44.940726 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245f94-f906-4479-a2e5-6c90bcd21e39 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:44.944718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1210/2401] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:44.945904 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:44.948555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:44.984264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a05dc-84b0-4b45-8a1f-6d18966ce6e1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:44.986092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1192/2402] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:44.987681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366041-f176-4515-8358-69aa42d46680 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:44.987975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366041-f176-4515-8358-69aa42d46680 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:44.988256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366041-f176-4515-8358-69aa42d46680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.009246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.010270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.010665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.011727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.021686 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.024337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.030281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b7366041-f176-4515-8358-69aa42d46680 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:45.032847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b7366041-f176-4515-8358-69aa42d46680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:45.058798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1193/2403] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:45.063948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7366041-f176-4515-8358-69aa42d46680 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.074553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1211/2404] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:45.089291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.090199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7366041-f176-4515-8358-69aa42d46680 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.095026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.095717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.096010 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.096282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.097059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:45.097377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.099208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.108835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0a0c-e183-4a48-967c-36dccb54cd17 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.116022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1194/2405] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:45.117210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.118534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.118921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.119474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] PATH_INFO: `/v3/projects/c28bd9ede8734f3aa585b48f53cbbbac/users/b086dca5b1b447eea7a95331a1556d10/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.122226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.134770 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915f66-bfaa-44b7-8e79-3e59f39df18e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.154321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28bd9ede8734f3aa585b48f53cbbbac, user_id=b086dca5b1b447eea7a95331a1556d10, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.157455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.158151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.158444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.158728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.162681 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.166116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.168350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.230404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1212/2406] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:45 2022] PUT /identity/v3/projects/c28bd9ede8734f3aa585b48f53cbbbac/users/b086dca5b1b447eea7a95331a1556d10/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:45.234754 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.235767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1195/2407] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:45 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:45.240735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.300025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:45.399845 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111e78-f7cf-4b4c-9bfb-27aaaa6c9a1c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.408391 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.409539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.409990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.410504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.411749 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.413375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d366-a308-4798-889a-f175bdaacaac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.423671 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.426515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.426825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.427101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.427855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.430494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.430663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.446187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1213/2408] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:45.447643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.461429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5b2c-7fec-4c95-a849-04a68355804a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.499302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1196/2409] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:45 2022] POST /identity/v3/users => generated 284 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:45.500287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.505394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701968b8-1829-49ca-9fb0-24a5829c5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.513267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701968b8-1829-49ca-9fb0-24a5829c5b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.513267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701968b8-1829-49ca-9fb0-24a5829c5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.513568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701968b8-1829-49ca-9fb0-24a5829c5b51 admin admin] PATH_INFO: `/v3/projects/c28bd9ede8734f3aa585b48f53cbbbac/users/b086dca5b1b447eea7a95331a1556d10/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.522776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701968b8-1829-49ca-9fb0-24a5829c5b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28bd9ede8734f3aa585b48f53cbbbac, user_id=b086dca5b1b447eea7a95331a1556d10, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.525092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c455e3-a0ec-4680-b0d3-b5a4b94ef890 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.537974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701968b8-1829-49ca-9fb0-24a5829c5b51 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.539638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.540340 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.540777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.541169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.541838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.543471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.587909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1214/2410] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:45 2022] PUT /identity/v3/projects/c28bd9ede8734f3aa585b48f53cbbbac/users/b086dca5b1b447eea7a95331a1556d10/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:19:45.598874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061946f-0c08-45fc-8701-6c269258556f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.599228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061946f-0c08-45fc-8701-6c269258556f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.599440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061946f-0c08-45fc-8701-6c269258556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.601367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1197/2411] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:45.617817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.651069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7758ec5-8d07-487a-a8a1-422d27df2f00 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.693699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-d061946f-0c08-45fc-8701-6c269258556f None None] MFA Rules not processed for user `b086dca5b1b447eea7a95331a1556d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:45.695005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d061946f-0c08-45fc-8701-6c269258556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:45.823346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.824532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.824864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.825223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.827219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.829227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.854628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1198/2412] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:45.857145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.860929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:45.892176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef3bb-7744-4a4b-9e18-5675c7cd4b3e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.895429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1215/2413] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:45.896375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061946f-0c08-45fc-8701-6c269258556f None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:45.905712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.905712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.905712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.905712 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] PATH_INFO: `/v3/projects/5221a135dcfa4926a06712f2083fcc7d` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.907177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5221a135dcfa4926a06712f2083fcc7d)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:45.913323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:45.915676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061946f-0c08-45fc-8701-6c269258556f None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:45.936350 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:45.937446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:45.937789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:45.938092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] PATH_INFO: `/v3/projects/6d844ea1b3244ada95478b94e39e64e5/users/3925f3224a1744ccaef829be5c2da4ae/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:45.948227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:46.017296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d844ea1b3244ada95478b94e39e64e5, user_id=3925f3224a1744ccaef829be5c2da4ae, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:46.021710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:46.057627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1216/2414] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:45 2022] PUT /identity/v3/projects/6d844ea1b3244ada95478b94e39e64e5/users/3925f3224a1744ccaef829be5c2da4ae/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:46.066082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:46.070250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5221a135dcfa4926a06712f2083fcc7d', 'request_id': 'req-c575779b-f04b-4cd4-af63-29eec06bbab5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:46.076139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:46.082482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5221a135dcfa4926a06712f2083fcc7d', 'request_id': 'req-c575779b-f04b-4cd4-af63-29eec06bbab5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:46.101191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5221a135dcfa4926a06712f2083fcc7d', 'request_id': 'req-c575779b-f04b-4cd4-af63-29eec06bbab5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:46.126138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] The token cache is being invalidate because project 5221a135dcfa4926a06712f2083fcc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:46.126452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:46.129094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c575779b-f04b-4cd4-af63-29eec06bbab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:46.131453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1199/2415] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:45 2022] DELETE /identity/v3/projects/5221a135dcfa4926a06712f2083fcc7d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:46.132710 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718cc9-60c9-4d42-993c-7ff156fad236 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.132998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718cc9-60c9-4d42-993c-7ff156fad236 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.133277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718cc9-60c9-4d42-993c-7ff156fad236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.171549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5a718cc9-60c9-4d42-993c-7ff156fad236 None None] MFA Rules not processed for user `3925f3224a1744ccaef829be5c2da4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:46.173311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5a718cc9-60c9-4d42-993c-7ff156fad236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:46.177931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:46.256050 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0ffd8-a509-458e-ace3-1234bb9c920a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:46.266975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:46.267770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.268187 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.268672 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.272368 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:46.326694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1200/2416] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:46.328048 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bd05-5e1c-475a-b3fd-185ad6261b07 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.328277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bd05-5e1c-475a-b3fd-185ad6261b07 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.328557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bd05-5e1c-475a-b3fd-185ad6261b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.369780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6cc7bd05-5e1c-475a-b3fd-185ad6261b07 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:46.373116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6cc7bd05-5e1c-475a-b3fd-185ad6261b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:46.436310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:46.438255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:46.452250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1217/2417] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:46.453433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:46.455348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:46.561995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ad24-7808-4315-8ef3-0984eba37d87 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:46.574051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1201/2418] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:46.595372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:46.599443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.599940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.600467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.601012 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.613865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.614537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:46.615061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.623400 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:46.697313 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:46.700739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:46.728789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1202/2419] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:46.733596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:46.735165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1218/2420] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:46 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:46.739315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:46.750436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944f8c-bb2c-475a-81c3-b9cd86df39fb None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:46.787386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:46.852421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3e153-76db-4e4f-bdaf-782cecf00c62 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:46.866500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:46.867815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.868101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.868380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.870010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:46.876471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:46.878601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:46.883110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:46.883110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:46.883351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:46.884028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:46.884343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:46.891855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:46.930348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1203/2421] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:46.931595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:46.946781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1219/2422] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:46 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:46.954264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:46.983921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5efe9d-5895-4f2d-af82-36e81cf37c26 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:46.996665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9211-63ec-4f49-9842-a42ea5a231ad admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.006469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.008794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.008794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.009646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.011189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.017362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.024754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.025551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.029798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.030168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.030931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.046208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1220/2423] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:47.046444 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.048622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.074659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a5945-9003-4b04-8aa0-bdcd402d1c8c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.092330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.093484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.093882 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.094445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] PATH_INFO: `/v3/projects/f380f1b6bb5f4062986da941b19eed3c/users/72c4ec19d8424ceb89c39a580d6ff463/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.126960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f380f1b6bb5f4062986da941b19eed3c, user_id=72c4ec19d8424ceb89c39a580d6ff463, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.131637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.152260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1204/2424] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:46 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:47.153957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.165245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1221/2425] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:47 2022] PUT /identity/v3/projects/f380f1b6bb5f4062986da941b19eed3c/users/72c4ec19d8424ceb89c39a580d6ff463/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:47.172257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.185033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:47.265474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00ae6-a516-4a67-b104-848a825c0474 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.275055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.275855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.276216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.276555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.277614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.279480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.296660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1222/2426] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:47.300233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5fafb-31f7-49c9-afe5-c77f6482a4f4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.301756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.307732 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.308857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.308857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.309482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.310485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.312231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.315928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78bd3d-0fac-49a8-8d77-8c9d41a6e961 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.322540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52390-2a54-4ebd-a4bc-5d23b3f81cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.324701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52390-2a54-4ebd-a4bc-5d23b3f81cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.325061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52390-2a54-4ebd-a4bc-5d23b3f81cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.325504 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52390-2a54-4ebd-a4bc-5d23b3f81cc0 admin admin] PATH_INFO: `/v3/projects/f380f1b6bb5f4062986da941b19eed3c/users/72c4ec19d8424ceb89c39a580d6ff463/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.328836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad52390-2a54-4ebd-a4bc-5d23b3f81cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f380f1b6bb5f4062986da941b19eed3c, user_id=72c4ec19d8424ceb89c39a580d6ff463, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.331212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad52390-2a54-4ebd-a4bc-5d23b3f81cc0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.340590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1205/2427] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:47 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:47.344815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.344960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1223/2428] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:47 2022] PUT /identity/v3/projects/f380f1b6bb5f4062986da941b19eed3c/users/72c4ec19d8424ceb89c39a580d6ff463/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:47.356246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.356511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.356981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.357800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70194-be64-48c2-a21a-c6338dc3dfc1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.441931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.442763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.442895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] MFA Rules not processed for user `72c4ec19d8424ceb89c39a580d6ff463`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:47.443395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.443769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.444163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:47.444766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.446732 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.467138 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1206/2429] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:47.468483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.480589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4e25-ae38-46d6-a362-fc28f74b5bc7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.488897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.489815 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.490107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.490400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.491201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.492897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.508561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1207/2430] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:47.509522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.524724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef4ef-24f7-4610-ac22-03046e67a1ce admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.530452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.531552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.531851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.532640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] PATH_INFO: `/v3/projects/19de3d45e12e40a9949c91c7f1cd4fe3/users/25c25a40827e4737a7ae823dee8615be/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.556376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19de3d45e12e40a9949c91c7f1cd4fe3, user_id=25c25a40827e4737a7ae823dee8615be, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.559985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.576465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:47.640551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1224/2432] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:47.641584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.643733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:47.644046 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1208/2432] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:47 2022] PUT /identity/v3/projects/19de3d45e12e40a9949c91c7f1cd4fe3/users/25c25a40827e4737a7ae823dee8615be/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:47.645816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:47.647784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:47.740173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:47.769135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd03f30-0249-4284-90bf-c060e77ef15e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.773439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ecbd4-0b36-41ae-aa97-61318f75d8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.774109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ecbd4-0b36-41ae-aa97-61318f75d8fa service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.774400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ecbd4-0b36-41ae-aa97-61318f75d8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.774681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ecbd4-0b36-41ae-aa97-61318f75d8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.809393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b6fd4-9686-451a-88a2-fe8a10e7cd02 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:47.840653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:47.840653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.840653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.840653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:47.844007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:47.949532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ecbd4-0b36-41ae-aa97-61318f75d8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.952843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ecbd4-0b36-41ae-aa97-61318f75d8fa service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.966256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:47.973325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1209/2433] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:47.979278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:47.984949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:47.987294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:47.987599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:48.019236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1225/2434] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:48.072570 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:48.077592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:48.257990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1210/2435] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:48.299123 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:48.301066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:48.535110 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:48.542137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b37ef-5e90-495a-b3f4-9c743506e1ac service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:48.559661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010c322-f3ba-4b57-855a-e5ab996fa2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:48.560743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010c322-f3ba-4b57-855a-e5ab996fa2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:48.560743 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010c322-f3ba-4b57-855a-e5ab996fa2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:48.561027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010c322-f3ba-4b57-855a-e5ab996fa2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:48.592515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010c322-f3ba-4b57-855a-e5ab996fa2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:48.594087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010c322-f3ba-4b57-855a-e5ab996fa2ca service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:48.619278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1226/2436] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:48.661217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:48.674499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e569f-cfb6-4388-990f-5948426a41d9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:48.678642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a38bf4-7b86-4ff4-aede-367e8c67e92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:48.679502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38bf4-7b86-4ff4-aede-367e8c67e92f service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:48.679954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38bf4-7b86-4ff4-aede-367e8c67e92f service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:48.680386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38bf4-7b86-4ff4-aede-367e8c67e92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:48.751581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:48.796032 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a38bf4-7b86-4ff4-aede-367e8c67e92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:48.799329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a38bf4-7b86-4ff4-aede-367e8c67e92f service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:48.832935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1211/2437] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:51.647515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:51.648474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:51.648803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:51.681536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] MFA Rules not processed for user `b88d284f57a44ddcb0f1347942a2950b`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:51.682901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:51.811007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1227/2438] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:52.581021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:52.582073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:52.583323 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:52.650730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] MFA Rules not processed for user `25c25a40827e4737a7ae823dee8615be`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:52.652063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:52.855899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1212/2439] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:52.908260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:52.922927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eeab1-3efe-4143-aa40-7bfed571dfe6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:52.932165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:52.933225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:52.934550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:52.934985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:52.955670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:52.960634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:52.993085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1228/2440] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:53.452763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:53.471688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c117a5-157b-48cd-8f97-3a8d2bc19cbc None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:53.479060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:53.480923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:53.482563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:53.483339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:53.489081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:53.701803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:53.714180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50678b8c-586f-4641-b18d-62be2b97d82c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:53.772067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1213/2441] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:54.865230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:54.892009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df386fe-5f3a-4a48-8545-7c1728ccfa12 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:54.907302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:54.910074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:54.911229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:54.913205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] PATH_INFO: `/v3/users/3925f3224a1744ccaef829be5c2da4ae` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:54.914932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3925f3224a1744ccaef829be5c2da4ae)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:54.922610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:55.003889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03f947-d258-4d93-bdca-4d74c324336f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:55.004544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03f947-d258-4d93-bdca-4d74c324336f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:55.004796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03f947-d258-4d93-bdca-4d74c324336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:55.029257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7f03f947-d258-4d93-bdca-4d74c324336f None None] MFA Rules not processed for user `25c25a40827e4737a7ae823dee8615be`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:55.030885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7f03f947-d258-4d93-bdca-4d74c324336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:55.049960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1214/2442] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:55.086942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3925f3224a1744ccaef829be5c2da4ae'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:55.117717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3925f3224a1744ccaef829be5c2da4ae'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:55.183032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3925f3224a1744ccaef829be5c2da4ae'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:55.186798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3925f3224a1744ccaef829be5c2da4ae'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:55.227403 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3925f3224a1744ccaef829be5c2da4ae'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:55.241153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:55.241733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:55.242346 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:55.244354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1229/2443] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:54 2022] DELETE /identity/v3/users/3925f3224a1744ccaef829be5c2da4ae => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:55.275023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:55.276695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:55.408687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1215/2444] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:19:55.439547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:55.441294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:55.570083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaeec3-f4bd-4ef9-8e70-48359b100123 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:55.584005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:55.584712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:55.585571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:55.587061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:55.613601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:55.615105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:55.619627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:55.634890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1230/2445] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:56.719755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:56.721554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:56.737636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:56.752504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df09de4-2ed8-4b2a-8279-ad1dbc9b1947 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:56.761935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:56.763424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:56.763717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:56.764257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] PATH_INFO: `/v3/projects/6d844ea1b3244ada95478b94e39e64e5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:56.766135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d844ea1b3244ada95478b94e39e64e5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:56.769442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:56.924246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d844ea1b3244ada95478b94e39e64e5', 'request_id': 'req-31ee5c24-6242-4f90-b7a4-2edfa854ada5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:56.939590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d844ea1b3244ada95478b94e39e64e5', 'request_id': 'req-31ee5c24-6242-4f90-b7a4-2edfa854ada5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:56.955611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d844ea1b3244ada95478b94e39e64e5', 'request_id': 'req-31ee5c24-6242-4f90-b7a4-2edfa854ada5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:56.972910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] The token cache is being invalidate because project 6d844ea1b3244ada95478b94e39e64e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:56.973692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:56.974845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:56.978755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1216/2446] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:56 2022] DELETE /identity/v3/projects/6d844ea1b3244ada95478b94e39e64e5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:56.982870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:56.999576 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae55f-6dff-4a71-b812-587a2b477507 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:57.181280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:57.184171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:57.184850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:57.201874 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] PATH_INFO: `/v3/users/72c4ec19d8424ceb89c39a580d6ff463` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:57.209523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:57.209807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c4ec19d8424ceb89c39a580d6ff463)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:57.210972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:57.218342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:57.230164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee5c24-6242-4f90-b7a4-2edfa854ada5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:57.238343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:57.240287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:57.240840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:57.241600 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] PATH_INFO: `/v3/users/ec3246173d424db2bc80e30fa5ca3744` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:57.243123 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3246173d424db2bc80e30fa5ca3744)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:57.245823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:57.375895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3246173d424db2bc80e30fa5ca3744'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.376466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3246173d424db2bc80e30fa5ca3744'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.378469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c4ec19d8424ceb89c39a580d6ff463'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.404172 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c4ec19d8424ceb89c39a580d6ff463'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.419761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3246173d424db2bc80e30fa5ca3744'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.449739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c4ec19d8424ceb89c39a580d6ff463'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.450853 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c4ec19d8424ceb89c39a580d6ff463'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.458677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3246173d424db2bc80e30fa5ca3744'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.459237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3246173d424db2bc80e30fa5ca3744'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.469638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-77abd333-fef2-4a5e-84f4-e26b2035076a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c4ec19d8424ceb89c39a580d6ff463'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:57.484246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1231/2447] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:56 2022] DELETE /identity/v3/users/72c4ec19d8424ceb89c39a580d6ff463 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:57.504487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1217/2448] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:57 2022] DELETE /identity/v3/users/ec3246173d424db2bc80e30fa5ca3744 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:57.506393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:57.506673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:57.507183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:57.552263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:57.553516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:57.696838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1232/2449] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:57.706114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:57.707567 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:57.831588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974f83-fbd8-4762-947a-b1fa78669565 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:57.835569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:57.836253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:57.837307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:57.837597 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:57.847965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:57.849715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:57.863307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1218/2450] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:19:58.425849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:58.426838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:58.442210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1df08-16bf-4f03-81c7-6dc6db258be0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:58.457362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:58.458283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:58.458572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:58.458855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] PATH_INFO: `/v3/projects/46c9666b35754ebaa73b424bd2192975` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:58.469652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c9666b35754ebaa73b424bd2192975)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:58.471683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:58.489161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:58.623337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c9666b35754ebaa73b424bd2192975', 'request_id': 'req-41995cf6-cf8d-45ec-9898-d70f593d3784'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:58.624561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:58.626145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:58.639762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:58.645603 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c9666b35754ebaa73b424bd2192975', 'request_id': 'req-41995cf6-cf8d-45ec-9898-d70f593d3784'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:58.649709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a75dd-0cd3-4791-ae11-7366faf7c4cd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:58.658180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c9666b35754ebaa73b424bd2192975', 'request_id': 'req-41995cf6-cf8d-45ec-9898-d70f593d3784'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:58.702923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] The token cache is being invalidate because project 46c9666b35754ebaa73b424bd2192975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:58.720396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:58.722588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:58.727582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1233/2451] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:58 2022] DELETE /identity/v3/projects/46c9666b35754ebaa73b424bd2192975 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:58.733660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:58.740185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:58.849321 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:58.854369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:58.854865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:58.857488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] PATH_INFO: `/v3/projects/f380f1b6bb5f4062986da941b19eed3c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:58.862995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f380f1b6bb5f4062986da941b19eed3c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:58.865353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:58.926398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995cf6-cf8d-45ec-9898-d70f593d3784 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:58.940075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:58.941098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:58.941390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:58.941675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] PATH_INFO: `/v3/users/d79d4e5948db427da4f28cbd19fe852a` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:58.944807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79d4e5948db427da4f28cbd19fe852a)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:58.947356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.026429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f380f1b6bb5f4062986da941b19eed3c', 'request_id': 'req-c54a3094-0e94-48c6-b9b9-08f622f109f2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.036318 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f380f1b6bb5f4062986da941b19eed3c', 'request_id': 'req-c54a3094-0e94-48c6-b9b9-08f622f109f2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.054393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79d4e5948db427da4f28cbd19fe852a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.064684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79d4e5948db427da4f28cbd19fe852a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.070156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f380f1b6bb5f4062986da941b19eed3c', 'request_id': 'req-c54a3094-0e94-48c6-b9b9-08f622f109f2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.083271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79d4e5948db427da4f28cbd19fe852a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.084084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79d4e5948db427da4f28cbd19fe852a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.100338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bd4ac926-bd31-482d-aa17-290281dcc288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79d4e5948db427da4f28cbd19fe852a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.106776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] The token cache is being invalidate because project f380f1b6bb5f4062986da941b19eed3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:59.107368 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.108377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c54a3094-0e94-48c6-b9b9-08f622f109f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.114386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1219/2452] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:58 2022] DELETE /identity/v3/projects/f380f1b6bb5f4062986da941b19eed3c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:59.116251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.116734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.117146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1234/2453] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:58 2022] DELETE /identity/v3/users/d79d4e5948db427da4f28cbd19fe852a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:59.117404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.206073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:59.207685 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:59.388236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1220/2454] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:59.394048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.394343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.394630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.417890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:59.419271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:59.429868 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1235/2455] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:59.433923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.451161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ba543-f4ef-4b97-a26f-9194c00266b1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.461335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.462186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.462556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.462905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.467913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:19:59.468316 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:59.471050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d85dc-e314-4e12-ad43-4fc295b66f39 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.511288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1221/2456] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:19:59.515981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.530693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741d50a-28a5-4c28-ba4c-71f024672c95 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.546185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.546911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.547207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.547485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.548203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:59.550325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.552951 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.553251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.553544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.566312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:59.579857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:59.582462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] MFA Rules not processed for user `63d18c022a19438d88562ef8e8c3fbce`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:19:59.599939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:59.611546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1236/2457] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:19:59 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:19:59.617724 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.700382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1222/2458] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:19:59.701487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.703155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:59.715402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975284-8db8-4be6-9159-e05e75e79b83 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.723031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.725351 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.725796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.726149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.728537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:59.731104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.748434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb249ec-5752-49b3-9ccc-49483db9299d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.755149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.756413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.757061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.757727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] PATH_INFO: `/v3/projects/0d1b56c641ab4a8fbccd7468087cb24c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.759292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1b56c641ab4a8fbccd7468087cb24c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:59.762290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.773268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1237/2459] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:19:59 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:19:59.777664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.807473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188857-4cb0-4ba7-8493-277b818946b3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.816344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.817244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.817703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.817703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.818404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:59.820150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.831420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1238/2460] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:19:59.835489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.842385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1b56c641ab4a8fbccd7468087cb24c', 'request_id': 'req-7ffa93a3-50b0-47db-a39a-05d07333b465'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.845957 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ea81b-7de4-4604-9af2-2c3e6bc92ea5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.850467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1b56c641ab4a8fbccd7468087cb24c', 'request_id': 'req-7ffa93a3-50b0-47db-a39a-05d07333b465'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.862154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1b56c641ab4a8fbccd7468087cb24c', 'request_id': 'req-7ffa93a3-50b0-47db-a39a-05d07333b465'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.881095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] The token cache is being invalidate because project 0d1b56c641ab4a8fbccd7468087cb24c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:19:59.881600 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.882533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:19:59.887132 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1223/2461] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:19:59 2022] DELETE /identity/v3/projects/0d1b56c641ab4a8fbccd7468087cb24c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:19:59.889867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.895150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:59.917572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.920684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.921354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.921835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.924472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:19:59.928057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:19:59.945922 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1239/2462] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:19:59.950433 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:19:59.957606 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:19:59.974767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bff98-3ec0-47bc-9376-4637f1714f02 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:19:59.983218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f9ed-44fa-4bb4-bcef-a68e80217821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:19:59.984349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f9ed-44fa-4bb4-bcef-a68e80217821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:19:59.984771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f9ed-44fa-4bb4-bcef-a68e80217821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:19:59.985096 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f9ed-44fa-4bb4-bcef-a68e80217821 admin admin] PATH_INFO: `/v3/projects/21c2a8e434794756a6d30a659746c622/users/23e39ce9eff6439faf5217c5baef171d/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:19:59.996372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa93a3-50b0-47db-a39a-05d07333b465 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:00.003411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:00.004477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:00.004867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:00.005243 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] PATH_INFO: `/v3/users/b086dca5b1b447eea7a95331a1556d10` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:00.006573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b086dca5b1b447eea7a95331a1556d10)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:00.008356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f9ed-44fa-4bb4-bcef-a68e80217821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c2a8e434794756a6d30a659746c622, user_id=23e39ce9eff6439faf5217c5baef171d, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:00.009001 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:00.011599 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f9ed-44fa-4bb4-bcef-a68e80217821 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:00.032984 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1240/2463] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:19:59 2022] PUT /identity/v3/projects/21c2a8e434794756a6d30a659746c622/users/23e39ce9eff6439faf5217c5baef171d/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:00.044428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:00.044815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:00.045341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:00.081499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:00.091022 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] MFA Rules not processed for user `23e39ce9eff6439faf5217c5baef171d`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:00.092750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:00.106772 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b086dca5b1b447eea7a95331a1556d10'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:00.107495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b086dca5b1b447eea7a95331a1556d10'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:00.134124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b086dca5b1b447eea7a95331a1556d10'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:00.142783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:00.153880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b086dca5b1b447eea7a95331a1556d10'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:00.154553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b086dca5b1b447eea7a95331a1556d10'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:00.178707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1224/2464] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:19:59 2022] DELETE /identity/v3/users/b086dca5b1b447eea7a95331a1556d10 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:20:00.195202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1241/2465] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:00.209289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:00.211030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:00.318447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a351-15b1-4964-9a86-4f016191868c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:00.324004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e457f-4945-4897-9340-279629ddc1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:00.324522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e457f-4945-4897-9340-279629ddc1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:00.325086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e457f-4945-4897-9340-279629ddc1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:00.325441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e457f-4945-4897-9340-279629ddc1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:00.397156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e457f-4945-4897-9340-279629ddc1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:00.399228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e457f-4945-4897-9340-279629ddc1b3 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:00.424035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1225/2466] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:01.104171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:01.108512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:01.237200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2155e8e-02f9-42e3-a8a6-11b689871086 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:01.281848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbc4d-a79b-4536-adb4-37cce337f83f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.282352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbc4d-a79b-4536-adb4-37cce337f83f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.282352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbc4d-a79b-4536-adb4-37cce337f83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.308222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fa6dbc4d-a79b-4536-adb4-37cce337f83f None None] MFA Rules not processed for user `8c5d1f4f0bec40ad8e325f8f92739b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:01.309528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fa6dbc4d-a79b-4536-adb4-37cce337f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:01.350355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:01.351335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.351679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.352074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] PATH_INFO: `/v3/projects/c28bd9ede8734f3aa585b48f53cbbbac` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.353684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28bd9ede8734f3aa585b48f53cbbbac)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:01.355767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:01.373644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1226/2467] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:20:01.423419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28bd9ede8734f3aa585b48f53cbbbac', 'request_id': 'req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:01.438668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28bd9ede8734f3aa585b48f53cbbbac', 'request_id': 'req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:01.446590 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28bd9ede8734f3aa585b48f53cbbbac', 'request_id': 'req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:01.466212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] The token cache is being invalidate because project c28bd9ede8734f3aa585b48f53cbbbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:01.466508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:01.467171 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-186f8b0a-47db-4ab6-ad9b-6a11b5f3b075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:01.468769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1242/2468] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:01 2022] DELETE /identity/v3/projects/c28bd9ede8734f3aa585b48f53cbbbac => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:01.474766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.475146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.475995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.502479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:01.520021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:01.522068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:01.610941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1227/2469] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:01.618713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.619011 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.619299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.638839 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:01.640538 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:01.657381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:01.663402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1243/2470] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:01.676192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397e3ee-919c-4bea-87ce-0164e53fdbbe None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:01.685479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:01.686356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.686839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.687134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.687894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:20:01.688351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:01.690315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:01.717313 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1228/2471] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:20:01.718592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:01.724956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:01.732899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fb0c4-db3f-4199-91d8-aac121af40f0 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:01.748085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:01.749103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.749456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.749809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.750613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:01.753243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:01.795240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1244/2472] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:20:01 2022] POST /identity/v3/projects => generated 401 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:01.800631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:01.818922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae72be-382d-44bd-95e9-b99acd39715a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:01.910613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:01.911574 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:01.912037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:01.912416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:01.914013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:01.916978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:01.955107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:01.956793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1229/2473] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:20:01 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:01.972616 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427e52f-f1f1-4a7d-909e-1d21ec644353 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.006488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.007399 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.007917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.008301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.009655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.012201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.031190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:02.033177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1245/2474] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:02.045532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508403-6335-436b-b075-0e8d84a674ab admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.053015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ad38f-af84-45fc-a10f-f6925c99ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.057052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ad38f-af84-45fc-a10f-f6925c99ce42 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.057391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ad38f-af84-45fc-a10f-f6925c99ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.057820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ad38f-af84-45fc-a10f-f6925c99ce42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.060561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ad38f-af84-45fc-a10f-f6925c99ce42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.063017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ad38f-af84-45fc-a10f-f6925c99ce42 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.086456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:02.087886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1230/2475] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:02.101003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086eb0d-e8fd-408d-9034-af708edb2ffd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.107771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.109822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.110356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.111017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] PATH_INFO: `/v3/projects/25cdc3bc03b5479cba814a043a20678c/users/a7e9fbe200de46e4a8c80ed02b5133c7/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.139741 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cdc3bc03b5479cba814a043a20678c, user_id=a7e9fbe200de46e4a8c80ed02b5133c7, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.143099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.170021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1246/2476] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:02 2022] PUT /identity/v3/projects/25cdc3bc03b5479cba814a043a20678c/users/a7e9fbe200de46e4a8c80ed02b5133c7/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:02.183645 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.184168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.184568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.225038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] MFA Rules not processed for user `a7e9fbe200de46e4a8c80ed02b5133c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:02.226207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:02.374191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:02.392202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1231/2477] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:02.394396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:02.555450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cffc82-e792-41f6-8460-5e5ffbadb64d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.590468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.591545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.593773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.594170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.595015 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.598124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.668080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1247/2478] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:20:02 2022] POST /identity/v3/projects => generated 399 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:02.673290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:02.687636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c498-d918-4ac4-9767-f8d2f1c75d6b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.820880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.821677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.821969 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.822251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.823390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.827576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.855000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1232/2479] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:20:02 2022] POST /identity/v3/users => generated 306 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:20:02.859338 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:02.879758 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f08b-c592-4b13-b292-a010135e7fef admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.893408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.893985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.894270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.894548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.895296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.897085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.909160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1248/2480] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:20:02.914236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:02.926101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe09db8-d9db-4d11-9b14-abc97fbba8d3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:02.933338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:02.934793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:02.935437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:02.935923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] PATH_INFO: `/v3/projects/5f1eca10ff3747b3b9ea991a56d20b02/users/91dbfee128164545aefd06ad4805ae1b/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:02.966523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1eca10ff3747b3b9ea991a56d20b02, user_id=91dbfee128164545aefd06ad4805ae1b, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:02.969773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:02.994054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1233/2481] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:02 2022] PUT /identity/v3/projects/5f1eca10ff3747b3b9ea991a56d20b02/users/91dbfee128164545aefd06ad4805ae1b/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:02.998265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:03.017930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea525e7-d653-4e2f-8c64-0f4579e16b2e admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:03.098716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768196e-8afc-4a1c-9026-19a9c5440d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:03.099624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768196e-8afc-4a1c-9026-19a9c5440d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:03.100005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768196e-8afc-4a1c-9026-19a9c5440d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:03.100387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768196e-8afc-4a1c-9026-19a9c5440d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:03.101302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768196e-8afc-4a1c-9026-19a9c5440d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:03.103161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768196e-8afc-4a1c-9026-19a9c5440d35 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:03.116155 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1249/2482] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:03.120013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:03.134553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31dfb-c523-496d-88c7-a695220356a9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:03.140854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:03.142549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:03.143099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:03.143498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] PATH_INFO: `/v3/projects/5f1eca10ff3747b3b9ea991a56d20b02/users/91dbfee128164545aefd06ad4805ae1b/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:03.145727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1eca10ff3747b3b9ea991a56d20b02, user_id=91dbfee128164545aefd06ad4805ae1b, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:03.148617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:03.161910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1234/2483] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:03 2022] PUT /identity/v3/projects/5f1eca10ff3747b3b9ea991a56d20b02/users/91dbfee128164545aefd06ad4805ae1b/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:20:03.172954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:03.173668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:03.173956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:03.208635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] MFA Rules not processed for user `91dbfee128164545aefd06ad4805ae1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:03.210746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:03.215614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:03.303471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1250/2484] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:03.315177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:03.317175 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:03.379750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae860d-1f6b-45fe-9c1d-e6527fdaa223 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:03.383437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687568e0-c5b5-41a9-bf05-05b1daa6ee6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:03.384093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687568e0-c5b5-41a9-bf05-05b1daa6ee6c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:03.384380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687568e0-c5b5-41a9-bf05-05b1daa6ee6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:03.384706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687568e0-c5b5-41a9-bf05-05b1daa6ee6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:03.394295 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687568e0-c5b5-41a9-bf05-05b1daa6ee6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:03.395759 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687568e0-c5b5-41a9-bf05-05b1daa6ee6c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:03.405583 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1235/2485] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:03.485851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:03.496203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b3935-52b3-4226-b466-c535094adb61 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:03.501129 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:03.501835 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:03.502130 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:03.502409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:03.559996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:03.561507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:03.570667 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1251/2486] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:06.820361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:06.821239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:06.822060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:06.866845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:06.868808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:06.948363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:06.973043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1236/2487] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:06.993394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:06.995565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:07.131318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954a0c-bc22-4bca-8830-a0bf76e287b0 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:07.137428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:07.138478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:07.138798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:07.139082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:07.151475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:07.153167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:07.190939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1252/2488] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:20:09.185876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:09.187390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:09.332180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f97754-5638-4f44-b7c6-f46e2f0d1a6c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:09.342092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:09.342917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:09.343312 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:09.343603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:09.354294 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:09.411343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:09.468687 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:09.521581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:09.523375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0211c-bd46-43ad-8c41-f4d9e43ed210 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:09.537436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1237/2489] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:09.540918 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd287-401e-457d-9096-e6c42979c501 service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:09.569106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:09.570281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:09.570730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:09.571008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] PATH_INFO: `/v3/users/a7e9fbe200de46e4a8c80ed02b5133c7` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:09.577586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e9fbe200de46e4a8c80ed02b5133c7)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:09.579975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:09.740167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e9fbe200de46e4a8c80ed02b5133c7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:09.749294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e9fbe200de46e4a8c80ed02b5133c7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:09.777186 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e9fbe200de46e4a8c80ed02b5133c7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:09.778222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e9fbe200de46e4a8c80ed02b5133c7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:09.798194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e9fbe200de46e4a8c80ed02b5133c7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:09.815820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1253/2490] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:20:09 2022] DELETE /identity/v3/users/a7e9fbe200de46e4a8c80ed02b5133c7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:09.822437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:09.822748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:09.823037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:09.864856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:09.866307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:09.906290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:09.907748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:10.020563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546c330-9d9a-4938-ba82-85dde2eceebd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:10.021206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1238/2491] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:10.033188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:10.036108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:10.037143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:10.037501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:10.037622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:10.037907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] PATH_INFO: `/v3/users/23e39ce9eff6439faf5217c5baef171d` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:10.039373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e39ce9eff6439faf5217c5baef171d)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:10.041653 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:10.104563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:10.111495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e39ce9eff6439faf5217c5baef171d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:10.114456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:10.124145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e39ce9eff6439faf5217c5baef171d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:10.148256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e39ce9eff6439faf5217c5baef171d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:10.149147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e39ce9eff6439faf5217c5baef171d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:10.156011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec5b0-e5f4-414a-b926-b75b42980cbe None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:10.160888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:10.161557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:10.161898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:10.162157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:10.162816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0ababc31-eda3-4d8f-b331-434a16f566d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e39ce9eff6439faf5217c5baef171d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:10.179715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:10.181222 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:10.185263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1254/2492] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:20:09 2022] DELETE /identity/v3/users/23e39ce9eff6439faf5217c5baef171d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:20:10.190707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:10.190707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:10.190707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:10.208396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1239/2493] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:10.219048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:10.220886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:10.306891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1255/2494] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:20:10.328355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:10.339706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f74ca-14a6-41ac-8dea-5c0bbe8dfc22 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:10.470239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:10.471350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:10.471737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:10.472145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:10.496760 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:10.498620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:10.538868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1240/2495] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:11.162305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:11.164863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:11.191777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52d9de-0769-4c8a-9fc7-e2571a602db1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:11.197153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:11.198236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:11.198458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:11.198771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] PATH_INFO: `/v3/projects/25cdc3bc03b5479cba814a043a20678c` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:11.201059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25cdc3bc03b5479cba814a043a20678c)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:11.204059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:11.237862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:11.245489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:11.309562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c392f1-5c60-41d3-b3c5-715fe59e7770 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:11.322567 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25cdc3bc03b5479cba814a043a20678c', 'request_id': 'req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.344082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25cdc3bc03b5479cba814a043a20678c', 'request_id': 'req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.366254 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25cdc3bc03b5479cba814a043a20678c', 'request_id': 'req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.396488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] The token cache is being invalidate because project 25cdc3bc03b5479cba814a043a20678c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:11.396867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.399105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.404442 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1256/2496] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:11 2022] DELETE /identity/v3/projects/25cdc3bc03b5479cba814a043a20678c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:11.406039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:11.409591 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:11.478533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:11.479475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:11.479784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:11.480061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] PATH_INFO: `/v3/projects/21c2a8e434794756a6d30a659746c622` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:11.488206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c2a8e434794756a6d30a659746c622)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:11.493296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:11.555262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:11.588852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f5f9-9cc4-488a-a4e6-d2283cf3b25d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:11.611732 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:11.612928 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:11.613225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:11.613589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] PATH_INFO: `/v3/users/91dbfee128164545aefd06ad4805ae1b` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:11.616087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91dbfee128164545aefd06ad4805ae1b)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:11.622650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:11.658947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c2a8e434794756a6d30a659746c622', 'request_id': 'req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.685089 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c2a8e434794756a6d30a659746c622', 'request_id': 'req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.703555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c2a8e434794756a6d30a659746c622', 'request_id': 'req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.739935 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] The token cache is being invalidate because project 21c2a8e434794756a6d30a659746c622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:11.740511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.742669 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d87b6f9b-ec75-4c2b-9158-de5b86169b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.749791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1241/2497] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:11 2022] DELETE /identity/v3/projects/21c2a8e434794756a6d30a659746c622 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:11.755586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4dd65-45a1-4c09-961a-d6a8d38552af None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:11.756235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4dd65-45a1-4c09-961a-d6a8d38552af None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:11.756790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4dd65-45a1-4c09-961a-d6a8d38552af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:11.797331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91dbfee128164545aefd06ad4805ae1b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.809784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b2a4dd65-45a1-4c09-961a-d6a8d38552af None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:11.813258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b2a4dd65-45a1-4c09-961a-d6a8d38552af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:11.818318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91dbfee128164545aefd06ad4805ae1b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.843348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:11.866225 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91dbfee128164545aefd06ad4805ae1b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.866986 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91dbfee128164545aefd06ad4805ae1b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.887291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-ac6d964c-11a8-492a-aaec-d7caaa211829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91dbfee128164545aefd06ad4805ae1b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:11.912968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1257/2498] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:20:11 2022] DELETE /identity/v3/users/91dbfee128164545aefd06ad4805ae1b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:11.914805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:11.915143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:11.915406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:11.938907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1242/2499] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:11.941179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:11.941629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:11.942066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:11.951664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:11.964783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:11.986283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:11.987933 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:12.130594 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1258/2500] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:12.160195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.162583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:12.177435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1243/2501] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:12.179244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.209012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c65c6-2111-4ef5-8296-ae29c7065901 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.218614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.219499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.219909 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.220257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.221043 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:20:12.221421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.229425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.260653 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1244/2502] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:20:12.264414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.293450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d50f7-b46b-4a4b-ae98-48915f80bb91 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.305209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.306117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.306326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.306660 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.307404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.309668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.385635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1245/2503] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:20:12 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:12.388857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.415259 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde867d9-6a92-49dc-a2aa-8211dd6940a3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.439216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:12.526458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb179f-a9f2-401d-8865-55f0493fced2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.536440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.538659 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.539641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.541373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.543239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.549053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.584335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.585196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.585489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.585837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.607094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1246/2504] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:20:12 2022] POST /identity/v3/users => generated 281 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:12.612224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.645361 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859fbd-41bf-440c-b39e-9aae2c654130 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.659611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.660625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.660920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.661203 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.661974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.663647 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.697409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:12.706735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1247/2505] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:12.707460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.729406 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5b82b-79c9-44f0-9a8e-141d0f55b4c7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.734344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.736180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.736728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb469891-574c-4509-912b-90c81be7c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.738214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469891-574c-4509-912b-90c81be7c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.738725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469891-574c-4509-912b-90c81be7c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.739338 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469891-574c-4509-912b-90c81be7c9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.745610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1259/2506] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:20:12.748972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469891-574c-4509-912b-90c81be7c9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.751387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469891-574c-4509-912b-90c81be7c9d4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.768255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1248/2507] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:12.769847 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:12.781871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4d190-34a5-4d40-b5a7-874b833edb97 service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:12.806173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:12.807193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.807570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.807942 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] PATH_INFO: `/v3/projects/954671b6f2714f58b44628e8aa4ce5c5/users/a81fb172b34641818db3fd5bfb349ea4/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:12.848402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=954671b6f2714f58b44628e8aa4ce5c5, user_id=a81fb172b34641818db3fd5bfb349ea4, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:12.853139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:12.895136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1260/2508] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:12 2022] PUT /identity/v3/projects/954671b6f2714f58b44628e8aa4ce5c5/users/a81fb172b34641818db3fd5bfb349ea4/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:12.897844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:12.898244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:12.898691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:13.035114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] MFA Rules not processed for user `a81fb172b34641818db3fd5bfb349ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:13.036628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:13.217226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1249/2509] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:13.273829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:13.275945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:13.436393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae641b-da07-4b9f-87d3-39c2037edabe admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:13.444374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:13.445524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:13.446149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:13.446452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:13.480668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:13.482282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:13.516571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1261/2510] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:20:13.523822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:13.690257 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:13.692114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:13.709429 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0848d-e809-46ed-93c5-c7d9c70fad0d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:13.722228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:13.724644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:13.726616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:13.726911 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] PATH_INFO: `/v3/users/a81fb172b34641818db3fd5bfb349ea4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:13.729748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81fb172b34641818db3fd5bfb349ea4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:13.733252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:13.741675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c3ede-a33e-467d-a6ce-2e75cff2eab9 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:13.788717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:13.788717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:13.788717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:13.788717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] PATH_INFO: `/v3/projects/5f1eca10ff3747b3b9ea991a56d20b02` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:13.789464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1eca10ff3747b3b9ea991a56d20b02)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:13.791410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:13.853997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:13.876416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1eca10ff3747b3b9ea991a56d20b02', 'request_id': 'req-dcf095df-9bed-4880-9e07-5f938f739600'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.877083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81fb172b34641818db3fd5bfb349ea4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.880098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81fb172b34641818db3fd5bfb349ea4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.891533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1eca10ff3747b3b9ea991a56d20b02', 'request_id': 'req-dcf095df-9bed-4880-9e07-5f938f739600'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.900827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81fb172b34641818db3fd5bfb349ea4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.907563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1eca10ff3747b3b9ea991a56d20b02', 'request_id': 'req-dcf095df-9bed-4880-9e07-5f938f739600'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.913456 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81fb172b34641818db3fd5bfb349ea4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.914609 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-041562c5-0b3f-40ec-a204-2c874aadab73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81fb172b34641818db3fd5bfb349ea4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.927534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:13.935188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] The token cache is being invalidate because project 5f1eca10ff3747b3b9ea991a56d20b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:13.935548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.939212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dcf095df-9bed-4880-9e07-5f938f739600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:13.939717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1250/2511] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:20:13 2022] DELETE /identity/v3/users/a81fb172b34641818db3fd5bfb349ea4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:13.942408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:13.943059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:13.943659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1262/2512] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:13 2022] DELETE /identity/v3/projects/5f1eca10ff3747b3b9ea991a56d20b02 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:13.943803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:13.950602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb23329-0c57-4a75-833a-63ca96f435fa None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:13.950907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb23329-0c57-4a75-833a-63ca96f435fa None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:13.951236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb23329-0c57-4a75-833a-63ca96f435fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:13.980253 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:13.990264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:13.997527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-2cb23329-0c57-4a75-833a-63ca96f435fa None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:13.999165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2cb23329-0c57-4a75-833a-63ca96f435fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:14.098136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1263/2513] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:14.099391 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.099610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.099947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.123340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:14.124717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:14.134103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1264/2514] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:14.138673 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.153684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaac16-1014-4735-a35f-3cfed0193ef8 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.159418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.160545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.160971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.161512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.162508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:20:14.163252 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.165058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.179704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1265/2515] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:20:14.184704 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.193572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1251/2516] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:14.197573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f33dac-e40b-42c1-9e31-bb96cdcf72db admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.200131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.202821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:14.219943 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.223179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.223325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.224083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.225979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.229713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.293144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1266/2517] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:20:14 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:14.294174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.328790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907e5b-881e-4333-bc58-f1da823b9a67 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.401506 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492004b-60bb-4978-b60c-248e81b40345 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.408267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.409206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.409489 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.409707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.410085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.410200 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.410695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.410990 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.411275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.414095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.424264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.426041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.449169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1252/2518] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:20:14.461931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1267/2519] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:20:14 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:14.466864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.479013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decb73b-fc00-4dda-a776-0e3e9bc9cdbd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.492254 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.493106 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.493503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.493855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.494672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.500096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.526779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1253/2520] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:14.529435 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.537641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:14.546965 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58ce2-1b71-474d-ad3c-49766616d0ce admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.568467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02ea07-8de1-4311-9b7d-3de752d53af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.569523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02ea07-8de1-4311-9b7d-3de752d53af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.570063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02ea07-8de1-4311-9b7d-3de752d53af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.570499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02ea07-8de1-4311-9b7d-3de752d53af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.572819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02ea07-8de1-4311-9b7d-3de752d53af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.576377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02ea07-8de1-4311-9b7d-3de752d53af5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.647454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1268/2521] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:14.650562 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:14.675920 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb655-e833-4152-950a-840d092b30e1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:14.682704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:14.683993 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.684446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.685865 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] PATH_INFO: `/v3/projects/6b24a1b7f4844671a51e36b1fcb4e0fb/users/70e1ca2caf624df1848af4a8a638ec37/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.728438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b24a1b7f4844671a51e36b1fcb4e0fb, user_id=70e1ca2caf624df1848af4a8a638ec37, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:14.734311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:14.765059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1254/2522] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:14 2022] PUT /identity/v3/projects/6b24a1b7f4844671a51e36b1fcb4e0fb/users/70e1ca2caf624df1848af4a8a638ec37/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:14.770623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:14.771097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:14.771382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:14.831140 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] MFA Rules not processed for user `70e1ca2caf624df1848af4a8a638ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:14.838800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:15.010703 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1269/2523] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:15.020706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:15.023341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:15.067244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:15.133792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:15.139421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:15.156824 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe5d0-7307-4987-be86-765586b746a6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:15.168551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73375b1-83a6-4bbb-a75a-40ac9471dcb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:15.169544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73375b1-83a6-4bbb-a75a-40ac9471dcb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:15.170097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73375b1-83a6-4bbb-a75a-40ac9471dcb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:15.170526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73375b1-83a6-4bbb-a75a-40ac9471dcb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:15.188324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73375b1-83a6-4bbb-a75a-40ac9471dcb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:15.191784 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73375b1-83a6-4bbb-a75a-40ac9471dcb0 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:15.209214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1255/2524] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:15.247396 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e961165-1328-423c-8420-5bac45e60c47 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:15.271314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:15.273359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:15.273640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:15.273981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] PATH_INFO: `/v3/projects/954671b6f2714f58b44628e8aa4ce5c5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:15.275340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954671b6f2714f58b44628e8aa4ce5c5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:15.277660 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:15.380352 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954671b6f2714f58b44628e8aa4ce5c5', 'request_id': 'req-166eaa98-103f-4694-a4e9-d33eeb44caf7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:15.397127 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954671b6f2714f58b44628e8aa4ce5c5', 'request_id': 'req-166eaa98-103f-4694-a4e9-d33eeb44caf7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:15.408810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954671b6f2714f58b44628e8aa4ce5c5', 'request_id': 'req-166eaa98-103f-4694-a4e9-d33eeb44caf7'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:15.454889 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] The token cache is being invalidate because project 954671b6f2714f58b44628e8aa4ce5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:15.455241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:15.470334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-166eaa98-103f-4694-a4e9-d33eeb44caf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:15.472544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1270/2525] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:15 2022] DELETE /identity/v3/projects/954671b6f2714f58b44628e8aa4ce5c5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:15.477633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:15.477985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:15.478271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:15.531816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:15.538818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:15.724305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1256/2526] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:15.731597 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:15.732176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:15.732464 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:15.804085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:15.807342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:15.831277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1271/2527] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:15.835926 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:15.854973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b0229-ff63-4257-9d4f-edb4f2c103e1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:15.883373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:15.887485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:15.888633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:15.890129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:15.897852 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:20:15.900559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:15.910680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:15.982667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1257/2528] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:20:15.984458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:15.992158 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:15.999863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870fd24-aed4-4d10-b5da-5be80fe40c98 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:16.010247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:16.011329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:16.011820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:16.012264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:16.017213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:16.020521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:16.086447 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1272/2529] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:20:15 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:16.090693 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:16.115190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89526d-6426-4ac0-bd56-9df3b34bc68b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:16.407396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:16.408120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:16.408410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:16.408716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:16.409494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:16.411443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:16.448929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1258/2530] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:20:16 2022] POST /identity/v3/users => generated 296 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:16.450575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:16.463715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b1aa-d7cb-41b7-86a5-0d4401c61a5d admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:16.481802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:16.482976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:16.483480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:16.483971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:16.486237 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:16.493683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:16.524142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1273/2531] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:16.525718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:16.542199 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798f65-ebe4-4b61-bc3c-1557ad12e4f6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:16.555116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b290-39df-49da-a764-14543720f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:16.556379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b290-39df-49da-a764-14543720f21d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:16.558180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b290-39df-49da-a764-14543720f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:16.560109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b290-39df-49da-a764-14543720f21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:16.563407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59b290-39df-49da-a764-14543720f21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:16.566287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59b290-39df-49da-a764-14543720f21d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:16.599807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:16.611788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1259/2532] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:16.620466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5536f4e-8fd4-4d97-8185-d2d0cffa7303 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:16.637320 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:16.639664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:16.640175 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:16.640582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] PATH_INFO: `/v3/projects/3b5b68afb08a4e66bf1382234141e0d1/users/356b20a9163842d7999b7b5bed8f6c3c/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:16.663827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5b68afb08a4e66bf1382234141e0d1, user_id=356b20a9163842d7999b7b5bed8f6c3c, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:16.667309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:16.716501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1274/2533] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:16 2022] PUT /identity/v3/projects/3b5b68afb08a4e66bf1382234141e0d1/users/356b20a9163842d7999b7b5bed8f6c3c/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:16.717637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:16.718172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:16.718618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:16.778415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] MFA Rules not processed for user `356b20a9163842d7999b7b5bed8f6c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:16.780131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:16.830555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:17.059154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1260/2534] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:17.071209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:17.073803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:17.291321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bdbc7-1612-4f31-91d7-e34b01dda526 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:17.304231 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482f50-55e4-4baa-89ac-fac18aeb68c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:17.305087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482f50-55e4-4baa-89ac-fac18aeb68c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:17.305476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482f50-55e4-4baa-89ac-fac18aeb68c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:17.305852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482f50-55e4-4baa-89ac-fac18aeb68c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:17.325456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482f50-55e4-4baa-89ac-fac18aeb68c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:17.331045 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482f50-55e4-4baa-89ac-fac18aeb68c9 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:17.368484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1275/2535] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:18.163497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:18.165134 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:18.416366 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c4a7b-8cda-4499-ac43-7034975e6d04 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:18.426881 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:18.427886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:18.429469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:18.429982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] PATH_INFO: `/v3/users/70e1ca2caf624df1848af4a8a638ec37` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:18.433464 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e1ca2caf624df1848af4a8a638ec37)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:18.438308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:18.583633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e1ca2caf624df1848af4a8a638ec37'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:18.584776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e1ca2caf624df1848af4a8a638ec37'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:18.614548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e1ca2caf624df1848af4a8a638ec37'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:18.629389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e1ca2caf624df1848af4a8a638ec37'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:18.630381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e1ca2caf624df1848af4a8a638ec37'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:18.655072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1261/2536] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:20:18 2022] DELETE /identity/v3/users/70e1ca2caf624df1848af4a8a638ec37 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:18.660364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:18.661066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:18.661454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:18.687563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:18.689282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:18.859987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1276/2537] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:18.876068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:18.877766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:19.044910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:19.120730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72b150-1285-430a-8c18-ec8754810e70 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:19.147180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b7c0-bcfe-451d-a59e-376c247f15e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:19.147901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b7c0-bcfe-451d-a59e-376c247f15e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:19.148196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b7c0-bcfe-451d-a59e-376c247f15e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:19.148483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b7c0-bcfe-451d-a59e-376c247f15e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:19.179426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b7c0-bcfe-451d-a59e-376c247f15e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:19.180973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b7c0-bcfe-451d-a59e-376c247f15e0 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:19.225549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1262/2538] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:20.256955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.261398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:20.275760 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f10fb-3b3b-4a22-be26-98b0db707585 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.290039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.290039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.290039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.290039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] PATH_INFO: `/v3/projects/6b24a1b7f4844671a51e36b1fcb4e0fb` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.293071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b24a1b7f4844671a51e36b1fcb4e0fb)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.295988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:20.374112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:20.375607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b24a1b7f4844671a51e36b1fcb4e0fb', 'request_id': 'req-40a9f40d-4544-4b22-8473-47bdc09dd70a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:20.385334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b24a1b7f4844671a51e36b1fcb4e0fb', 'request_id': 'req-40a9f40d-4544-4b22-8473-47bdc09dd70a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:20.395133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b24a1b7f4844671a51e36b1fcb4e0fb', 'request_id': 'req-40a9f40d-4544-4b22-8473-47bdc09dd70a'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:20.406401 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] The token cache is being invalidate because project 6b24a1b7f4844671a51e36b1fcb4e0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:20.406696 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:20.407358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-40a9f40d-4544-4b22-8473-47bdc09dd70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:20.409180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1277/2539] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:20 2022] DELETE /identity/v3/projects/6b24a1b7f4844671a51e36b1fcb4e0fb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:20.414325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.415275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.415721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.435615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:20.437280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:20.528031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1263/2540] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:20.529979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.530472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.530762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.553298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:20.554517 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:20.570052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.575162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1278/2541] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:20.581334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643710aa-f596-46a6-84fb-508d8a07ee08 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.587822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.588498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.588922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.589293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.590162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:20:20.590573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.592383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:20.605067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1264/2542] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:20:20.609769 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.624873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e49e3-2804-4ed0-af8e-d1fc7bdec9e6 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.629803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.630612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.630900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.631180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.632002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.634023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:20.681135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1279/2543] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:20:20 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:20.687876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.701192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973568-d232-42bc-a3e2-a37910e8683b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.802095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.802804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.803107 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.804629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.804629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.806483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:20.834206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1265/2544] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:20:20 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:20:20.838207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.850976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3b2d-f721-48bb-acb9-c3ff60b729e3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.855901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.857429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.857429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.857429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.858275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.859867 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:20.871542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1280/2545] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:20:20.875689 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.886377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d81db6-661a-404d-8b4c-c78ba6b9ce21 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.891798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e6b12-4e28-439c-9f56-68ae09e9d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.892480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e6b12-4e28-439c-9f56-68ae09e9d729 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.892908 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e6b12-4e28-439c-9f56-68ae09e9d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.893242 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e6b12-4e28-439c-9f56-68ae09e9d729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.894098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e6b12-4e28-439c-9f56-68ae09e9d729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.895730 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e6b12-4e28-439c-9f56-68ae09e9d729 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:20.910375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1266/2546] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:20:20.912056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:20.942101 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce9713-34d1-43e1-ab36-7cbcff93710a admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:20.947002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:20.947993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:20.948337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:20.948720 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] PATH_INFO: `/v3/projects/4f2c6711640e4bee997f9eccea8dc1f2/users/83bb831069ff4df896e4d8c0370cc962/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:20.980475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2c6711640e4bee997f9eccea8dc1f2, user_id=83bb831069ff4df896e4d8c0370cc962, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:20.983894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:21.007647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1281/2547] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:20:20 2022] PUT /identity/v3/projects/4f2c6711640e4bee997f9eccea8dc1f2/users/83bb831069ff4df896e4d8c0370cc962/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:21.036586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589d0-aa4b-4224-9625-0a25b2cd6be9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:21.036586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589d0-aa4b-4224-9625-0a25b2cd6be9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:21.048744 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589d0-aa4b-4224-9625-0a25b2cd6be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:21.137248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-327589d0-aa4b-4224-9625-0a25b2cd6be9 None None] MFA Rules not processed for user `83bb831069ff4df896e4d8c0370cc962`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:21.139447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-327589d0-aa4b-4224-9625-0a25b2cd6be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:21.247546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:21.288499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1267/2548] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:21.307680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:21.310978 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:21.450985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581788-d946-42b2-b4ce-3c519f6a4300 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:21.454780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf1ca-6783-4806-a036-12dcfa12c900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:21.455445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf1ca-6783-4806-a036-12dcfa12c900 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:21.455785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf1ca-6783-4806-a036-12dcfa12c900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:21.456066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf1ca-6783-4806-a036-12dcfa12c900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:21.472373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf1ca-6783-4806-a036-12dcfa12c900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:21.474200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf1ca-6783-4806-a036-12dcfa12c900 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:21.485637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1282/2549] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:31.284282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:31.480384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=4,keystone:SELECT=69,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:39.505171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab8ac-7ea7-4d5e-a2ad-7422a69c25e0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:39.505734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab8ac-7ea7-4d5e-a2ad-7422a69c25e0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:39.505734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab8ac-7ea7-4d5e-a2ad-7422a69c25e0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:39.507303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1268/2550] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:20:39.513856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4825f-bf27-452b-95ef-05e5d3f5d7fd None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:39.514436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4825f-bf27-452b-95ef-05e5d3f5d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:39.514540 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4825f-bf27-452b-95ef-05e5d3f5d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:39.566277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-47c4825f-bf27-452b-95ef-05e5d3f5d7fd None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:39.567480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-47c4825f-bf27-452b-95ef-05e5d3f5d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:39.652240 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1283/2551] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:20:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:39.661947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab8ac-7ea7-4d5e-a2ad-7422a69c25e0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:39.664325 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-914ab8ac-7ea7-4d5e-a2ad-7422a69c25e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:39.759769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab8ac-7ea7-4d5e-a2ad-7422a69c25e0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:39.762593 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f82ab4-b841-45e0-8594-945c65f84174 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:39.763687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82ab4-b841-45e0-8594-945c65f84174 service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:39.764041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82ab4-b841-45e0-8594-945c65f84174 service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:39.764488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82ab4-b841-45e0-8594-945c65f84174 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:39.803925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f82ab4-b841-45e0-8594-945c65f84174 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:39.805646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f82ab4-b841-45e0-8594-945c65f84174 service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:39.818629 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1269/2552] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:39.889890 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a49d4-c951-44bf-817d-673bfa111f27 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:39.890255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a49d4-c951-44bf-817d-673bfa111f27 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:39.890662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a49d4-c951-44bf-817d-673bfa111f27 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:39.892226 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1284/2553] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:20:39.903800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a7995-87d3-475c-8a39-59ed9a60eff4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:39.904395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a7995-87d3-475c-8a39-59ed9a60eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:39.905343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a7995-87d3-475c-8a39-59ed9a60eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:39.925850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dc9a7995-87d3-475c-8a39-59ed9a60eff4 None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:39.927097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dc9a7995-87d3-475c-8a39-59ed9a60eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:39.982536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1270/2554] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:20:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:39.994896 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a49d4-c951-44bf-817d-673bfa111f27 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:39.996756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-751a49d4-c951-44bf-817d-673bfa111f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:40.011548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a49d4-c951-44bf-817d-673bfa111f27 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:40.015778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ccb50-a703-4853-b752-f6d2fda690cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:40.016483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ccb50-a703-4853-b752-f6d2fda690cb service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:40.016990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ccb50-a703-4853-b752-f6d2fda690cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:40.017274 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ccb50-a703-4853-b752-f6d2fda690cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:40.025914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ccb50-a703-4853-b752-f6d2fda690cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:40.027381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ccb50-a703-4853-b752-f6d2fda690cb service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:40.035717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1285/2555] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:40.130392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf2c3-faab-4da4-b8ab-2cfba93697f0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:40.130904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf2c3-faab-4da4-b8ab-2cfba93697f0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:40.131379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf2c3-faab-4da4-b8ab-2cfba93697f0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:40.132897 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1271/2556] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:20:40.139357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a55df-89e1-4eac-a9d5-c3d5e64b75ff None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:40.139727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a55df-89e1-4eac-a9d5-c3d5e64b75ff None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:40.140073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a55df-89e1-4eac-a9d5-c3d5e64b75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:40.162618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-250a55df-89e1-4eac-a9d5-c3d5e64b75ff None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:40.163862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-250a55df-89e1-4eac-a9d5-c3d5e64b75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:40.178005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1286/2557] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:20:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:40.189378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf2c3-faab-4da4-b8ab-2cfba93697f0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:40.191248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-14abf2c3-faab-4da4-b8ab-2cfba93697f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:40.204265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf2c3-faab-4da4-b8ab-2cfba93697f0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:40.207904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:40.208577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:40.209108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:40.209508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:40.220497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:40.222083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:40.233145 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1272/2558] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:43.010639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:43.011166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:43.011272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:43.063507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:43.064937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:43.136701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1287/2559] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:20:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:20:43.164531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:43.167245 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:43.265345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:43.270619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9fe1-432b-4c56-9355-351b97e7cc4d service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:43.276178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b3465-c91f-4a67-b24a-b947299cba41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:43.276900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b3465-c91f-4a67-b24a-b947299cba41 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:43.277201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b3465-c91f-4a67-b24a-b947299cba41 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:43.277532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b3465-c91f-4a67-b24a-b947299cba41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:43.286586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b3465-c91f-4a67-b24a-b947299cba41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:43.291183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b3465-c91f-4a67-b24a-b947299cba41 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:43.304691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1273/2560] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:20:43.367827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:43.369389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:43.399608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:43.524492 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22b781-0f53-4e9d-8d1a-0eff642253cf None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:43.531047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:43.532802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:43.533272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:43.533715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] PATH_INFO: `/v3/users/356b20a9163842d7999b7b5bed8f6c3c` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:43.535122 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=356b20a9163842d7999b7b5bed8f6c3c)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:43.537771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:43.653541 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356b20a9163842d7999b7b5bed8f6c3c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:43.665948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356b20a9163842d7999b7b5bed8f6c3c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:43.683937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356b20a9163842d7999b7b5bed8f6c3c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:43.684919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356b20a9163842d7999b7b5bed8f6c3c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:43.698920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356b20a9163842d7999b7b5bed8f6c3c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:43.710370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1288/2561] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:20:43 2022] DELETE /identity/v3/users/356b20a9163842d7999b7b5bed8f6c3c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:43.712518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:43.712882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:43.713212 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:43.738960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:43.741656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:43.852750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1274/2562] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:43.863775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:43.865327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:43.934773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43354-07fb-44ff-a09f-38b44b3c36dc admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:43.940381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:43.941179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:43.941498 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:43.942112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:43.953318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:43.955121 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:43.966848 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1289/2563] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:44.417515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:44.419925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:44.436563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc691-ac0f-419b-a5c2-9b2c8f35507a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:44.453787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:44.456176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:44.456594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:44.457443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] PATH_INFO: `/v3/projects/3b5b68afb08a4e66bf1382234141e0d1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:44.459636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5b68afb08a4e66bf1382234141e0d1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:44.462838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:44.602508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5b68afb08a4e66bf1382234141e0d1', 'request_id': 'req-c8a0a382-af20-4316-9a58-3ec67ab89926'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:44.616737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5b68afb08a4e66bf1382234141e0d1', 'request_id': 'req-c8a0a382-af20-4316-9a58-3ec67ab89926'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:44.652667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5b68afb08a4e66bf1382234141e0d1', 'request_id': 'req-c8a0a382-af20-4316-9a58-3ec67ab89926'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:44.686733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] The token cache is being invalidate because project 3b5b68afb08a4e66bf1382234141e0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:20:44.687079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:44.687786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c8a0a382-af20-4316-9a58-3ec67ab89926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:20:44.689767 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1275/2564] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:20:44 2022] DELETE /identity/v3/projects/3b5b68afb08a4e66bf1382234141e0d1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:20:47.631208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:47.632764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:47.690759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:47.794161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f326da8-4a16-4f24-bb2d-e9369967b70d service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:47.870280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:47.871147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:47.871505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:47.873420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:47.875574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:47.889066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:47.891055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:47.902947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1290/2565] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:20:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:20:50.224347 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdf41-03fc-48d7-9caa-c2c9a14a2267 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:50.225006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdf41-03fc-48d7-9caa-c2c9a14a2267 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:50.225006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdf41-03fc-48d7-9caa-c2c9a14a2267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:50.252506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-69bbdf41-03fc-48d7-9caa-c2c9a14a2267 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:20:50.254296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-69bbdf41-03fc-48d7-9caa-c2c9a14a2267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:50.325288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1276/2566] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:20:50.341293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:20:50.343327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:20:50.440029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57bc7e-a7ba-4fc7-b280-23fce1143328 service placement] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:20:50.446139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:20:50.447185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:20:50.447551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:20:50.447909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:20:50.458165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:20:50.460052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:20:50.469547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1291/2567] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:21:00.316356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:00.465699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=84 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:03.787886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:03.788436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:03.788436 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:03.807283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:21:03.808502 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:03.816352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1277/2568] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 17:21:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:21:03.829309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:03.840290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc32b0-e0cc-4bda-aa4f-e4bc10737da3 service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:03.846365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:03.847009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:03.847358 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:03.847637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:03.856108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:03.857768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:03.865914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1292/2569] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:21:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:21:05.409479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:05.410924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:05.471395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b130249-3666-4324-8634-28a1532bb4cf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:05.476804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:05.477468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:05.477755 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:05.478033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:05.479813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:05.558144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:05.559721 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:05.570028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1278/2570] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:21:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:21:05.899235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:05.900750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:05.996138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5aec6-99e1-42da-b421-787a048afa64 service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:06.001197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:06.002307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:06.002748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:06.003206 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] PATH_INFO: `/v3/users/b88d284f57a44ddcb0f1347942a2950b` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:06.005436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88d284f57a44ddcb0f1347942a2950b)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:06.008829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:06.077738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88d284f57a44ddcb0f1347942a2950b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.088526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88d284f57a44ddcb0f1347942a2950b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.111993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88d284f57a44ddcb0f1347942a2950b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.113081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88d284f57a44ddcb0f1347942a2950b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.121452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-7ef2fa64-a946-43b0-84e1-635908365df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88d284f57a44ddcb0f1347942a2950b'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.130931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1293/2571] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:21:05 2022] DELETE /identity/v3/users/b88d284f57a44ddcb0f1347942a2950b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:21:06.371231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:06.386370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d8df7-5ee0-4e77-a56e-a59f0062d282 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:06.459262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:06.460094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:06.460382 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:06.460694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] PATH_INFO: `/v3/projects/31c15be59539430b9f25b8236c4d03c7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:06.461919 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c15be59539430b9f25b8236c4d03c7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:06.463860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:06.509617 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:06.514541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c15be59539430b9f25b8236c4d03c7', 'request_id': 'req-2f0b2b8f-065d-4d44-a643-777a7f50ad84'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.522028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c15be59539430b9f25b8236c4d03c7', 'request_id': 'req-2f0b2b8f-065d-4d44-a643-777a7f50ad84'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.530391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c15be59539430b9f25b8236c4d03c7', 'request_id': 'req-2f0b2b8f-065d-4d44-a643-777a7f50ad84'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.541646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] The token cache is being invalidate because project 31c15be59539430b9f25b8236c4d03c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:21:06.541972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.542605 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:06.544171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1279/2572] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:21:06 2022] DELETE /identity/v3/projects/31c15be59539430b9f25b8236c4d03c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:21:16.124262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:16.538576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:20.519296 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:20.519771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:20.519886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:20.539295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:21:20.540707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:20.600185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1294/2573] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 17:21:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:21:20.612374 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:20.614055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:20.685268 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b2b8f-065d-4d44-a643-777a7f50ad84 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:20.690681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aec12e-83ea-4cc4-bbf1-8834c9d4f847 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:20.691450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aec12e-83ea-4cc4-bbf1-8834c9d4f847 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:20.691740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aec12e-83ea-4cc4-bbf1-8834c9d4f847 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:20.692019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aec12e-83ea-4cc4-bbf1-8834c9d4f847 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:20.700644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aec12e-83ea-4cc4-bbf1-8834c9d4f847 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:20.702351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aec12e-83ea-4cc4-bbf1-8834c9d4f847 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:20.710832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1280/2574] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:21:30.593162 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=25 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:30.707288 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=32 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:34.375205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:34.377193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:34.448807 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c97b-3678-4112-ab45-f4797b51afa4 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:34.454342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:34.455544 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:34.455779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:34.456059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] PATH_INFO: `/v3/users/83bb831069ff4df896e4d8c0370cc962` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:34.457461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bb831069ff4df896e4d8c0370cc962)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:34.459751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:34.517112 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bb831069ff4df896e4d8c0370cc962'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:34.523935 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bb831069ff4df896e4d8c0370cc962'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:34.535221 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bb831069ff4df896e4d8c0370cc962'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:34.535893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bb831069ff4df896e4d8c0370cc962'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:34.543373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bb831069ff4df896e4d8c0370cc962'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:34.550163 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1295/2575] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:21:34 2022] DELETE /identity/v3/users/83bb831069ff4df896e4d8c0370cc962 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:21:34.554833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:34.555381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:34.555381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:34.574491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:21:34.575692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:34.637235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1281/2576] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:21:34.647389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:34.648893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:34.709699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aea00c-396f-4076-8628-29793d8a004c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:34.714323 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b5110-6e55-4338-a2e8-4b27e26d48b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:34.714968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5110-6e55-4338-a2e8-4b27e26d48b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:34.715245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5110-6e55-4338-a2e8-4b27e26d48b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:34.715523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5110-6e55-4338-a2e8-4b27e26d48b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:34.725382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b5110-6e55-4338-a2e8-4b27e26d48b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:34.726836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b5110-6e55-4338-a2e8-4b27e26d48b4 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:34.738736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1296/2577] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:21:35.020549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:21:35.022169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:35.036002 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8be73-a612-47cf-a3e2-6b11cda2981d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:21:35.041230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:21:35.042264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:35.042558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:35.042892 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] PATH_INFO: `/v3/projects/4f2c6711640e4bee997f9eccea8dc1f2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:35.044079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2c6711640e4bee997f9eccea8dc1f2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:21:35.046101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:21:35.097019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2c6711640e4bee997f9eccea8dc1f2', 'request_id': 'req-f59f495d-434a-4334-b317-60a0b5825f39'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:35.103151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2c6711640e4bee997f9eccea8dc1f2', 'request_id': 'req-f59f495d-434a-4334-b317-60a0b5825f39'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:35.111033 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2c6711640e4bee997f9eccea8dc1f2', 'request_id': 'req-f59f495d-434a-4334-b317-60a0b5825f39'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:35.121290 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] The token cache is being invalidate because project 4f2c6711640e4bee997f9eccea8dc1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:21:35.121577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:35.122194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59f495d-434a-4334-b317-60a0b5825f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:21:35.123750 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1282/2578] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:21:35 2022] DELETE /identity/v3/projects/4f2c6711640e4bee997f9eccea8dc1f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:21:44.732511 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:45.118330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:46.972104 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69067d7-e01f-48a0-8698-5f330f781148 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:21:46.972680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69067d7-e01f-48a0-8698-5f330f781148 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:21:46.972680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69067d7-e01f-48a0-8698-5f330f781148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:21:46.990386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-b69067d7-e01f-48a0-8698-5f330f781148 None None] MFA Rules not processed for user `25c25a40827e4737a7ae823dee8615be`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:21:46.991639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-b69067d7-e01f-48a0-8698-5f330f781148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:21:47.050452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1297/2579] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:21:57.043420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=25 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:16.827238 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa0ff-bd65-4560-824e-7a5531dd2120 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:16.827781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa0ff-bd65-4560-824e-7a5531dd2120 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:16.827781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa0ff-bd65-4560-824e-7a5531dd2120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:16.847088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ac6aa0ff-bd65-4560-824e-7a5531dd2120 None None] MFA Rules not processed for user `8485b40daa3347d3a438c2006d9d4ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:22:16.848355 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ac6aa0ff-bd65-4560-824e-7a5531dd2120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:16.906330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1283/2580] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:22:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:22:19.191083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316d29-e65c-4533-8d66-2beda1853add None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:19.191850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316d29-e65c-4533-8d66-2beda1853add None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:19.191955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316d29-e65c-4533-8d66-2beda1853add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:19.218584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-49316d29-e65c-4533-8d66-2beda1853add None None] MFA Rules not processed for user `8c5d1f4f0bec40ad8e325f8f92739b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:22:19.219841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-49316d29-e65c-4533-8d66-2beda1853add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:19.282044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1298/2581] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:22:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:22:26.899218 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=25 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:29.272633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=25 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:40.120687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:40.121230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:40.121981 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:40.144443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] MFA Rules not processed for user `dc9c9dd337834dea821cc4ea6ecc10a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:22:40.145698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:40.203216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1284/2582] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:22:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:22:42.102405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316d29-e65c-4533-8d66-2beda1853add None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:42.104033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-49316d29-e65c-4533-8d66-2beda1853add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:42.172589 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316d29-e65c-4533-8d66-2beda1853add None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:42.176440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:42.177178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:42.178029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:42.178029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:42.180639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:42.255479 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:42.257009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:42.272128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1299/2583] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:22:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:22:43.381787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:43.397676 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd3a6-88a0-4f2c-913e-afb184ff30ec None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:43.402501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:43.403470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:43.403991 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:43.404296 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:43.412675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:43.430194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:43.431690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:43.445537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1285/2584] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:22:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:22:49.453560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:49.455135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:49.525371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a4f8-537a-45fe-b828-5ea08b1cf327 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:49.530000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:49.530898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:49.531173 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:49.531469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] PATH_INFO: `/v3/users/25c25a40827e4737a7ae823dee8615be` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:49.532677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c25a40827e4737a7ae823dee8615be)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:49.534650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:49.579721 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:49.582634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c25a40827e4737a7ae823dee8615be'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.590322 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c25a40827e4737a7ae823dee8615be'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.601860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c25a40827e4737a7ae823dee8615be'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.602534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c25a40827e4737a7ae823dee8615be'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.610575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c25a40827e4737a7ae823dee8615be'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.616726 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1300/2585] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:22:49 2022] DELETE /identity/v3/users/25c25a40827e4737a7ae823dee8615be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:22:49.806370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:49.817729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a4291-6da3-4ad2-a5b2-220bce98d9fa service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:49.874495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:49.875389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:49.875700 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:49.875978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] PATH_INFO: `/v3/projects/19de3d45e12e40a9949c91c7f1cd4fe3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:49.877275 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19de3d45e12e40a9949c91c7f1cd4fe3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:49.879231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:49.927611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19de3d45e12e40a9949c91c7f1cd4fe3', 'request_id': 'req-d1755c57-4834-44b0-8fca-5edead3b66a2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.933631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19de3d45e12e40a9949c91c7f1cd4fe3', 'request_id': 'req-d1755c57-4834-44b0-8fca-5edead3b66a2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.942422 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19de3d45e12e40a9949c91c7f1cd4fe3', 'request_id': 'req-d1755c57-4834-44b0-8fca-5edead3b66a2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.952823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] The token cache is being invalidate because project 19de3d45e12e40a9949c91c7f1cd4fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:22:49.953110 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.953733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:22:49.955261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1286/2586] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:22:49 2022] DELETE /identity/v3/projects/19de3d45e12e40a9949c91c7f1cd4fe3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:22:58.503979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:22:58.505613 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:58.567419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c91bb-4c90-4a0e-95cc-664c6da0c66e admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:22:58.617678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:22:58.618344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:22:58.618631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:22:58.618911 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:22:58.620775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:22:58.631980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:22:58.633409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:22:58.642362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1301/2587] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:22:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:22:59.949929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:02.617640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:02.619158 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:02.681070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755c57-4834-44b0-8fca-5edead3b66a2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:02.684861 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:02.685529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:02.685817 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:02.686095 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:02.688021 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:02.751768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:02.753454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51663bcc-1f68-4925-847c-5fc794ac623b service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:02.763996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1287/2588] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:08.639307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=4,keystone:SELECT=59,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:10.248033 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:10.250105 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:10.389921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029fbc-1c8e-43cf-bab9-6b4bd8dfc655 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:10.397785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:10.398601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:10.398930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:10.399211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:10.401354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:10.421909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:10.423825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:10.436375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1302/2589] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:11.351650 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:11.352164 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:11.352512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:11.372450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:11.373707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:11.457475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1288/2590] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 17:23:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:11.514388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:11.516086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:11.603972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ae531-32ac-4e90-b4ef-3f9786ca4a27 service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:11.609527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:11.610343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:11.610679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:11.610934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:11.620933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:11.622568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:11.631044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1303/2591] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:23:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:23:12.720522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:12.722226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:12.739934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded0df-a205-47ae-8977-293852ad1657 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:12.746458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:12.747142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:12.747431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:12.747711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:12.749607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:12.812378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:12.814088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:12.817887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:12.824924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1289/2592] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:19.046332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:19.047878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:19.121631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327826-3927-4204-98c0-5132a6f236a2 service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:19.126508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:19.127429 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:19.127761 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:19.128007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] PATH_INFO: `/v3/users/63d18c022a19438d88562ef8e8c3fbce` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:19.129298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d18c022a19438d88562ef8e8c3fbce)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:19.131277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:19.153454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:19.185930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d18c022a19438d88562ef8e8c3fbce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.193865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d18c022a19438d88562ef8e8c3fbce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.206860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d18c022a19438d88562ef8e8c3fbce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.207642 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d18c022a19438d88562ef8e8c3fbce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.217684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d18c022a19438d88562ef8e8c3fbce'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.225369 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1304/2593] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:23:19 2022] DELETE /identity/v3/users/63d18c022a19438d88562ef8e8c3fbce => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:19.408322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:19.421227 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f415-1e7e-47e6-a7de-47c502562bfd service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:19.491003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:19.491893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:19.492178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:19.492450 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] PATH_INFO: `/v3/projects/0cc6a8ff9f92432ba9433b78a948d042` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:19.493866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc6a8ff9f92432ba9433b78a948d042)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:19.495792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:19.543299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc6a8ff9f92432ba9433b78a948d042', 'request_id': 'req-36e3830e-b7cd-474b-b41d-e09cfc5edefb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.549855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc6a8ff9f92432ba9433b78a948d042', 'request_id': 'req-36e3830e-b7cd-474b-b41d-e09cfc5edefb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.558166 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc6a8ff9f92432ba9433b78a948d042', 'request_id': 'req-36e3830e-b7cd-474b-b41d-e09cfc5edefb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.568802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] The token cache is being invalidate because project 0cc6a8ff9f92432ba9433b78a948d042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:23:19.569163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.570412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.571984 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1290/2594] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:23:19 2022] DELETE /identity/v3/projects/0cc6a8ff9f92432ba9433b78a948d042 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:19.576623 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:19.578179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:19.591211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3a969-343d-4368-baa8-b60c44da8342 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:19.651287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:19.652197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:19.652482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:19.652814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] PATH_INFO: `/v3/users/b92f89251f814cd881ced9b0646e1faa` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:19.653997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92f89251f814cd881ced9b0646e1faa)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:19.656053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:19.719316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92f89251f814cd881ced9b0646e1faa'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.728468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92f89251f814cd881ced9b0646e1faa'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.741800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92f89251f814cd881ced9b0646e1faa'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.742631 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92f89251f814cd881ced9b0646e1faa'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.752281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92f89251f814cd881ced9b0646e1faa'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:19.759143 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1305/2595] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:23:19 2022] DELETE /identity/v3/users/b92f89251f814cd881ced9b0646e1faa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:19.947386 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:19.949077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:19.966067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3830e-b7cd-474b-b41d-e09cfc5edefb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:20.022317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:20.023236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:20.023510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:20.023932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] PATH_INFO: `/v3/projects/cdac656fd32c44868e4bf1189ef19965` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:20.025181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdac656fd32c44868e4bf1189ef19965)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:20.027141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:20.063413 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:20.077404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdac656fd32c44868e4bf1189ef19965', 'request_id': 'req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:20.083652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdac656fd32c44868e4bf1189ef19965', 'request_id': 'req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:20.092949 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdac656fd32c44868e4bf1189ef19965', 'request_id': 'req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:20.103917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] The token cache is being invalidate because project cdac656fd32c44868e4bf1189ef19965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:23:20.104210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:20.104882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:20.106481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1291/2596] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:23:19 2022] DELETE /identity/v3/projects/cdac656fd32c44868e4bf1189ef19965 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:24.149561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:24.151228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:24.167725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:24.214809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d479a-8e73-420b-b180-aba17692acbd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:24.273655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:24.274307 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:24.274592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:24.274864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:24.276771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:24.349430 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:24.350878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:24.361326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1306/2597] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:27.226204 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:27.227762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:27.297416 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:27.299973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:27.312494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa0b43-cc98-4a20-881d-121c7de7a6ce admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:27.318041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996393b-0127-468a-b017-18a96190a32a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:27.318733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996393b-0127-468a-b017-18a96190a32a service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.319024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996393b-0127-468a-b017-18a96190a32a service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.319309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996393b-0127-468a-b017-18a96190a32a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.321181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7996393b-0127-468a-b017-18a96190a32a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:27.325983 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c712662-f0d1-4344-9a2c-6c6d7ee9993d service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:27.333283 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:27.334315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.334677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.334913 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996393b-0127-468a-b017-18a96190a32a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:27.335095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] PATH_INFO: `/v3/users/8c5d1f4f0bec40ad8e325f8f92739b4d` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.336552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996393b-0127-468a-b017-18a96190a32a service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:27.337481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5d1f4f0bec40ad8e325f8f92739b4d)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:27.340255 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:27.347950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1292/2598] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:27.391370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5d1f4f0bec40ad8e325f8f92739b4d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.398643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5d1f4f0bec40ad8e325f8f92739b4d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.411370 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5d1f4f0bec40ad8e325f8f92739b4d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.412125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5d1f4f0bec40ad8e325f8f92739b4d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.414005 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:27.421244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-a61f0477-defe-4b14-a67f-84f629f2bd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5d1f4f0bec40ad8e325f8f92739b4d'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.428622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1307/2599] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:23:27 2022] DELETE /identity/v3/users/8c5d1f4f0bec40ad8e325f8f92739b4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:27.624431 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996393b-0127-468a-b017-18a96190a32a service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:27.645675 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996393b-0127-468a-b017-18a96190a32a service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:27.707375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:27.708297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.708624 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.708923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] PATH_INFO: `/v3/projects/9b1709bec893431599352cb6e470cf76` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.710215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1709bec893431599352cb6e470cf76)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:27.712202 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:27.761081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1709bec893431599352cb6e470cf76', 'request_id': 'req-27a05244-0cfb-4ca0-adad-13718603682a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.762508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:27.768943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1709bec893431599352cb6e470cf76', 'request_id': 'req-27a05244-0cfb-4ca0-adad-13718603682a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.778289 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1709bec893431599352cb6e470cf76', 'request_id': 'req-27a05244-0cfb-4ca0-adad-13718603682a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.790520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] The token cache is being invalidate because project 9b1709bec893431599352cb6e470cf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:23:27.790821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.791485 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-27a05244-0cfb-4ca0-adad-13718603682a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:23:27.797805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1293/2600] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:23:27 2022] DELETE /identity/v3/projects/9b1709bec893431599352cb6e470cf76 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:27.798411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.798711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.798995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.817585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:27.818888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:27.881652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1308/2601] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:27.889120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.889419 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.889703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.910388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:27.911601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:27.920785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1294/2602] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:27.925866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:27.941047 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dfe43-ccd6-4e35-9fbf-23c330bc07e5 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:27.950330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:27.951236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.951550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.951873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.952899 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:23:27.953280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:27.955827 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:27.969480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1309/2603] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:23:27.973884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:27.983324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0a36f-1009-4f38-a850-29933d41df9a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:27.989283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:27.989943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:27.990228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:27.990504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:27.991193 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:27.993160 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:28.020789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1295/2604] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:23:27 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:23:28.025000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:28.035854 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c500b-16ab-4bc4-a6fa-3b0ebadfa127 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:28.091063 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:28.091763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:28.092029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:28.092299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:28.093026 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:28.094949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:28.120066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1310/2605] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:23:28 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:23:28.124388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:28.136024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b7c30-c692-40a9-99d4-ff2fc4573da8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:28.141556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:28.142400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:28.142780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:28.143231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:28.144057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:28.145922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:28.157571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1296/2606] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:23:28.161419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:28.171757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcca4c-b986-41d2-b24c-b499e1c4c4f5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:28.176785 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50057381-0f25-42e3-9edf-f9701d8547d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:28.177459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50057381-0f25-42e3-9edf-f9701d8547d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:28.177748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50057381-0f25-42e3-9edf-f9701d8547d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:28.178027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50057381-0f25-42e3-9edf-f9701d8547d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:28.178763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50057381-0f25-42e3-9edf-f9701d8547d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:28.180413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50057381-0f25-42e3-9edf-f9701d8547d2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:28.193234 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1311/2607] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:23:28.197459 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:28.207497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dbae-2f68-408b-b5da-2256012b89b7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:28.212334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:28.213266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:28.213555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:28.213830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] PATH_INFO: `/v3/projects/054a5a15ef3c4200b1a78a890b077a53/users/6943ae00467244228fa6ac90e48c4cce/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:28.229014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054a5a15ef3c4200b1a78a890b077a53, user_id=6943ae00467244228fa6ac90e48c4cce, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:28.231681 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:28.245996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1297/2608] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:23:28 2022] PUT /identity/v3/projects/054a5a15ef3c4200b1a78a890b077a53/users/6943ae00467244228fa6ac90e48c4cce/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:23:28.251207 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68aae0-b84b-427e-b1dc-82fe49d32f4f None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:28.251499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68aae0-b84b-427e-b1dc-82fe49d32f4f None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:28.251775 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68aae0-b84b-427e-b1dc-82fe49d32f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:28.269509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0d68aae0-b84b-427e-b1dc-82fe49d32f4f None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:28.270764 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0d68aae0-b84b-427e-b1dc-82fe49d32f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:28.325830 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:28.338316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1312/2609] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:28.348093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:28.350169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:28.410263 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f101d-cc96-46c4-9945-701604a98c63 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:28.414402 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:28.415060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:28.415347 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:28.415627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:28.425229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:28.426687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:28.436272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1298/2610] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:29.182064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:29.182488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:29.182844 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:29.201739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:29.203074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:29.292497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1313/2611] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:23:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:29.305359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:29.307468 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:29.391879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dfd5f-addd-4686-b3ad-7f17859d2461 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:29.398104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b2a1-29f6-4b4c-a99b-ea99189f0bc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:29.398887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b2a1-29f6-4b4c-a99b-ea99189f0bc4 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:29.399248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b2a1-29f6-4b4c-a99b-ea99189f0bc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:29.399601 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b2a1-29f6-4b4c-a99b-ea99189f0bc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:29.409155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b2a1-29f6-4b4c-a99b-ea99189f0bc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:29.410930 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b2a1-29f6-4b4c-a99b-ea99189f0bc4 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:29.421216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1299/2612] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:23:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:23:31.048746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:31.050963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:31.199523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad0c1a-f318-4b4d-a4fd-d47dec7f2674 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:31.205222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:31.206004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:31.206293 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:31.206572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:31.208859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:31.224098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:31.225792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:31.241373 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1314/2613] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:34.350283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9bef-d755-44b7-95d1-ef21f1e2ae63 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:34.350854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9bef-d755-44b7-95d1-ef21f1e2ae63 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:34.350854 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9bef-d755-44b7-95d1-ef21f1e2ae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:34.376910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:34.406692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-604d9bef-d755-44b7-95d1-ef21f1e2ae63 None None] MFA Rules not processed for user `6943ae00467244228fa6ac90e48c4cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:34.409558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-604d9bef-d755-44b7-95d1-ef21f1e2ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:34.487640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1300/2614] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:23:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:34.507253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:34.508805 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:34.524456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068e89b-2112-4192-baf4-2b41a045eae0 service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:34.531713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:34.532533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:34.533061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:34.533491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:34.545132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:34.547418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:34.559748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1315/2615] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:36.317808 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:36.319301 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:36.319769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:36.350738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] MFA Rules not processed for user `6943ae00467244228fa6ac90e48c4cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:36.352322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:36.362510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1301/2616] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:23:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:36.734239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:36.749771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde3f5-1d1d-40b2-acd0-a9ac7d6e271a service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:36.757304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:36.758018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:36.758304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:36.758588 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:36.760565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:36.772884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:36.774363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:36.783261 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1316/2617] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:23:37.333709 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:37.335297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:37.463168 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3370b0-cf14-486e-a46c-e8c49d512c4e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:37.472763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:37.473778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:37.474241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:37.474667 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:37.476855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:37.497559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:37.499631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8cb5d-7dc8-4ea7-8129-345b1ef91d12 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:37.525003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1302/2618] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:23:46.099618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:46.108549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5a1a0-5bf5-4c36-b4df-a452371d6f5e service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:46.112855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:46.113500 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.113787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.114065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.115979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:46.125955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:46.127402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfede8a-dfda-4872-a888-3c869ec3c457 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:46.135327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1317/2619] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:46.246140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e28d-e794-4b88-8c4d-042da31cd399 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.246711 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e28d-e794-4b88-8c4d-042da31cd399 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.246904 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e28d-e794-4b88-8c4d-042da31cd399 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.248588 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1303/2620] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:23:46.254209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3921-79d7-4ad5-8baa-f7304e069224 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.254575 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3921-79d7-4ad5-8baa-f7304e069224 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.254910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3921-79d7-4ad5-8baa-f7304e069224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.276776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-db4c3921-79d7-4ad5-8baa-f7304e069224 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:46.278010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-db4c3921-79d7-4ad5-8baa-f7304e069224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:46.287494 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1318/2621] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:23:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:46.299451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6e28d-e794-4b88-8c4d-042da31cd399 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:46.301353 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c3e6e28d-e794-4b88-8c4d-042da31cd399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:46.359213 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6e28d-e794-4b88-8c4d-042da31cd399 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:46.362901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f554d-3267-473d-a478-ba180951e99c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:46.363546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f554d-3267-473d-a478-ba180951e99c service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.363836 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f554d-3267-473d-a478-ba180951e99c service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.364103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f554d-3267-473d-a478-ba180951e99c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.375463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f554d-3267-473d-a478-ba180951e99c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:46.376994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f554d-3267-473d-a478-ba180951e99c service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:46.388068 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1304/2622] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:46.457220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf33d1-2ebf-49f1-bd50-07298a716790 None None] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.457514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf33d1-2ebf-49f1-bd50-07298a716790 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.457797 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf33d1-2ebf-49f1-bd50-07298a716790 None None] PATH_INFO: `/` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.459313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1319/2623] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:23:46.464234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a8445-41d2-4072-a4fb-996e07f66bd1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.464560 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a8445-41d2-4072-a4fb-996e07f66bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.464876 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a8445-41d2-4072-a4fb-996e07f66bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.484910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8d6a8445-41d2-4072-a4fb-996e07f66bd1 None None] MFA Rules not processed for user `9584ad1287d346f89ef31dd00dc1609c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:46.486159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8d6a8445-41d2-4072-a4fb-996e07f66bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:46.493226 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1305/2624] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:23:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:46.504971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf33d1-2ebf-49f1-bd50-07298a716790 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:46.519355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf33d1-2ebf-49f1-bd50-07298a716790 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:46.523134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b27802-51f0-47f2-bbb0-f31601c4fcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:46.523804 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b27802-51f0-47f2-bbb0-f31601c4fcbc service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.524094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b27802-51f0-47f2-bbb0-f31601c4fcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.524367 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b27802-51f0-47f2-bbb0-f31601c4fcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.531765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b27802-51f0-47f2-bbb0-f31601c4fcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:46.533288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b27802-51f0-47f2-bbb0-f31601c4fcbc service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:46.542216 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1320/2625] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:46.631557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf7d9-528c-43e4-afae-319866e0297e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.631856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf7d9-528c-43e4-afae-319866e0297e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.632144 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf7d9-528c-43e4-afae-319866e0297e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.633632 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1306/2626] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 17:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:23:46.639431 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde5dbc-b5b4-43ee-8867-8fd0e6157ae6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.639722 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde5dbc-b5b4-43ee-8867-8fd0e6157ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.640010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde5dbc-b5b4-43ee-8867-8fd0e6157ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.659783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-9fde5dbc-b5b4-43ee-8867-8fd0e6157ae6 None None] MFA Rules not processed for user `12c6f9c481ec4108a86db440cc90311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:46.661057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-9fde5dbc-b5b4-43ee-8867-8fd0e6157ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:46.671691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1321/2627] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 17:23:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:46.682375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf7d9-528c-43e4-afae-319866e0297e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:46.684686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-85abf7d9-528c-43e4-afae-319866e0297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:46.700139 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf7d9-528c-43e4-afae-319866e0297e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:46.704031 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:46.704716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:46.705006 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:46.705283 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:46.715741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:46.717237 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:46.728066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1307/2628] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:49.499993 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:49.500524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:49.500524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:49.519647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:23:49.520913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:49.528556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1322/2629] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:23:49.540945 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:49.546630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:49.553552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8248a7-7dc2-4806-90d1-583e4d578f2f service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:49.558703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f059cf0-e6dc-478a-bf91-923c6882f6fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:49.559379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f059cf0-e6dc-478a-bf91-923c6882f6fb service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:49.559666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f059cf0-e6dc-478a-bf91-923c6882f6fb service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:49.559943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f059cf0-e6dc-478a-bf91-923c6882f6fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:49.568246 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f059cf0-e6dc-478a-bf91-923c6882f6fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:49.569888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f059cf0-e6dc-478a-bf91-923c6882f6fb service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:49.577887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1308/2630] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:23:50.681553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:23:50.697325 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be15ecb-216f-4581-ac79-6e4f032e9a99 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:23:50.704513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:23:50.705303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:23:50.705587 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:23:50.705877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:23:50.707685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:23:50.727929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:23:50.730092 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:23:50.742932 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1323/2631] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:23:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:23:59.575041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:00.737478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:04.454875 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:04.455360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:04.455471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:04.473690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:04.474885 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:04.482442 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1309/2632] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 17:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:24:04.494733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:04.507090 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709dfcd-ec16-45af-ab26-c6a2ff8b8733 service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:04.513299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:04.513947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:04.514236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:04.514514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:04.522964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:04.524709 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:04.532916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1324/2633] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:24:14.468825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:14.529729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:44.998299 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:45.010197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c256-de91-4797-89a4-a6d7029dd490 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:45.016350 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:45.017434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:45.017965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:45.018178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:45.022267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:45.038446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:45.040738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:45.051432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1310/2634] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:24:48.603568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:48.605109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:48.619120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda6897-3bf9-431d-98e3-c166c59318cc service swift] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:48.624114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:48.625084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:48.625372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:48.625657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] PATH_INFO: `/v3/users/8485b40daa3347d3a438c2006d9d4ef5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:48.626898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8485b40daa3347d3a438c2006d9d4ef5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:48.628906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:48.678518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8485b40daa3347d3a438c2006d9d4ef5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:48.685331 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8485b40daa3347d3a438c2006d9d4ef5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:48.697930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8485b40daa3347d3a438c2006d9d4ef5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:48.698701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8485b40daa3347d3a438c2006d9d4ef5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:48.706395 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-6cffc194-c416-485b-8920-536bd072d92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8485b40daa3347d3a438c2006d9d4ef5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:48.712810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1325/2635] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:24:48 2022] DELETE /identity/v3/users/8485b40daa3347d3a438c2006d9d4ef5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:24:48.906026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:48.916742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf7938-4dd3-4810-85fe-9b2ad392e9bd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:48.974079 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:48.974974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:48.975270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:48.975552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] PATH_INFO: `/v3/projects/5724b98399214909a99dec90c2718c44` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:48.976818 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5724b98399214909a99dec90c2718c44)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:48.978957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.026879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5724b98399214909a99dec90c2718c44', 'request_id': 'req-00414843-6b1d-4d56-846e-36971d4b55f2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:49.034674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5724b98399214909a99dec90c2718c44', 'request_id': 'req-00414843-6b1d-4d56-846e-36971d4b55f2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:49.043705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5724b98399214909a99dec90c2718c44', 'request_id': 'req-00414843-6b1d-4d56-846e-36971d4b55f2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:49.054893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] The token cache is being invalidate because project 5724b98399214909a99dec90c2718c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:24:49.055251 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:49.055996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-00414843-6b1d-4d56-846e-36971d4b55f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:24:49.057603 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1311/2636] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:24:48 2022] DELETE /identity/v3/projects/5724b98399214909a99dec90c2718c44 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:24:49.062659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.062956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.063241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.081925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:49.083170 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:49.147111 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1326/2637] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:24:49.155239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.155399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.155680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.174734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:49.175957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:49.184362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1312/2638] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:24:49.188772 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.198744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304bb54-9a51-44ec-a5d3-528eb0a11136 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.203990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.204683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.204974 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.205281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.206017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:24:49.206330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.207979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.220466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1327/2639] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:24:49.224737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.234270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4abe-3119-409e-baa4-12d65d606825 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.240214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.240927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.241216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.241513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.242228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.244206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.282282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1313/2640] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:24:49 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:24:49.288516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.299773 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90255b3-bf11-46c5-81e0-e2033f300709 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.362030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56711794-695c-450d-a382-5872f401a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.362734 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711794-695c-450d-a382-5872f401a08b admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.363025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711794-695c-450d-a382-5872f401a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.363308 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711794-695c-450d-a382-5872f401a08b admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.364004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56711794-695c-450d-a382-5872f401a08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.366004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56711794-695c-450d-a382-5872f401a08b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.373093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:49.390365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1328/2641] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:24:49 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:24:49.394652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.405420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e864-b1b9-48bd-b29e-57604bc162ad admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.410262 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.410943 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.411236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.411512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.412260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.413917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.424008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1314/2642] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:24:49.428183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56711794-695c-450d-a382-5872f401a08b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.439075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56711794-695c-450d-a382-5872f401a08b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.444629 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566485-e3bf-41e7-8112-e202d5633ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.445343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566485-e3bf-41e7-8112-e202d5633ece admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.445632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566485-e3bf-41e7-8112-e202d5633ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.445914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566485-e3bf-41e7-8112-e202d5633ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.446656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf566485-e3bf-41e7-8112-e202d5633ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.448297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf566485-e3bf-41e7-8112-e202d5633ece admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.459463 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1329/2643] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:24:49.464840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.486741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34e4f-d7a2-4222-b915-1bc08fc64a54 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.493887 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.494820 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.495137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.495495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] PATH_INFO: `/v3/projects/43c5da8fa182486990154b6f22539593/users/b4780bb497234a249b6d23afdab14370/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.514334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c5da8fa182486990154b6f22539593, user_id=b4780bb497234a249b6d23afdab14370, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.517125 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.532503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1315/2644] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:24:49 2022] PUT /identity/v3/projects/43c5da8fa182486990154b6f22539593/users/b4780bb497234a249b6d23afdab14370/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:24:49.537705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.538000 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.538281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.557645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:49.558849 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:49.623668 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1330/2645] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:24:49.634827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.637411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:49.645084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:49.698594 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739750a2-4e41-449e-914e-20d76df685bd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.702552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e73a-a234-4c17-9f17-bbff8bd03f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.703233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e73a-a234-4c17-9f17-bbff8bd03f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.703521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e73a-a234-4c17-9f17-bbff8bd03f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.703801 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e73a-a234-4c17-9f17-bbff8bd03f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.713025 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e73a-a234-4c17-9f17-bbff8bd03f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.714481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e73a-a234-4c17-9f17-bbff8bd03f68 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.727658 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1316/2646] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:24:49.853695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:49.855610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:49.915881 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3485d-1f23-4aa1-a4b9-13c137ff5130 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:49.919622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:49.920294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:49.920666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:49.920951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:49.923120 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:49.987434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:49.989059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:49.998634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1331/2647] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:24:53.863075 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cf4a-1757-4eb0-801c-8b02c906ec30 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:53.863526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cf4a-1757-4eb0-801c-8b02c906ec30 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:53.863615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cf4a-1757-4eb0-801c-8b02c906ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:53.917545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3fb9cf4a-1757-4eb0-801c-8b02c906ec30 None None] MFA Rules not processed for user `b4780bb497234a249b6d23afdab14370`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:53.920096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3fb9cf4a-1757-4eb0-801c-8b02c906ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:54.032455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1317/2648] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:24:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:24:54.077744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:24:54.079744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:54.122536 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:54.163241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731037d-32cd-4ae4-82ac-46d63dcc1297 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:24:54.169213 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a30fc3-8046-4a54-966b-430a9e1fb2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:24:54.169894 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a30fc3-8046-4a54-966b-430a9e1fb2e5 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:54.170174 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a30fc3-8046-4a54-966b-430a9e1fb2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:54.170451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a30fc3-8046-4a54-966b-430a9e1fb2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:54.180895 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a30fc3-8046-4a54-966b-430a9e1fb2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:24:54.183044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a30fc3-8046-4a54-966b-430a9e1fb2e5 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:24:54.195070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1332/2649] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:24:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:24:55.583780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:55.584293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:55.584293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:55.603228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] MFA Rules not processed for user `b4780bb497234a249b6d23afdab14370`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:55.604573 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:55.611901 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1318/2650] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:24:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:24:57.103802 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:24:57.104763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:24:57.105202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:24:57.126664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] MFA Rules not processed for user `dc9c9dd337834dea821cc4ea6ecc10a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:24:57.128377 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:24:57.136215 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1333/2651] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:25:05.597781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=59 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:07.119031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=22 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:16.220506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:25:16.233435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393a304-aed7-41a7-b74b-285d8d73605b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:25:16.239250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:25:16.240211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:25:16.240795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:25:16.241133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:25:16.244029 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:25:16.332120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:25:16.334153 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5282e-8fd0-4aa4-81d8-4db81da21874 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:25:16.347837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1319/2652] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:25:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:25:26.341183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=30 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:49.938006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:25:49.939509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:25:50.012243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5007d-b773-4ae4-9f43-8409dedcaf53 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:25:50.017803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:25:50.018474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:25:50.018759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:25:50.019036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:25:50.021010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:25:50.032662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:25:50.034260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc04ec-d66d-4ce5-b19a-52a7b8a2ebda service placement] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:25:50.044360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1334/2653] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:25:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:25:55.078798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4253d81-b19e-4892-b311-14cb3e789c91 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:25:55.079319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4253d81-b19e-4892-b311-14cb3e789c91 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:25:55.079434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4253d81-b19e-4892-b311-14cb3e789c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:25:55.096942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a4253d81-b19e-4892-b311-14cb3e789c91 None None] MFA Rules not processed for user `b4780bb497234a249b6d23afdab14370`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:25:55.098169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a4253d81-b19e-4892-b311-14cb3e789c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:25:55.106072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1320/2654] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:25:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:26:00.040194 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=32 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:05.092188 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:31.457816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:26:31.458384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:26:31.458384 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:26:31.476562 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] MFA Rules not processed for user `6943ae00467244228fa6ac90e48c4cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:26:31.477787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:26:31.544454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1335/2655] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:26:41.535266 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=25 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:56.596223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:26:56.596792 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:26:56.596900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:26:56.615494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] MFA Rules not processed for user `b4780bb497234a249b6d23afdab14370`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:26:56.616771 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:26:56.625281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1321/2656] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:26:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:03.537149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:03.538799 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:03.551197 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af752a94-9070-4346-ac18-5d46d5686b93 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:03.554695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:03.555365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:03.555650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:03.555940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:03.557718 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:03.569817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:03.571260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:03.581097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1336/2657] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:27:06.610506 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:06.819101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:06.820547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:06.836396 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db8047-d963-4ce7-932f-58092401a2bd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:06.841580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:06.842439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:06.842819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:06.843223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:06.845478 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:06.858148 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:06.859809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:06.873466 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1322/2658] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:27:10.411058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:10.413034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:10.427985 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c705-d3cc-4b0d-b1e6-d8bf1101793e service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:10.434664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:10.436229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:10.436781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:10.437290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] PATH_INFO: `/v3/users/dc9c9dd337834dea821cc4ea6ecc10a6` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:10.438790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9c9dd337834dea821cc4ea6ecc10a6)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:10.441286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:10.515931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9c9dd337834dea821cc4ea6ecc10a6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.524113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9c9dd337834dea821cc4ea6ecc10a6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.540345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9c9dd337834dea821cc4ea6ecc10a6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.541264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9c9dd337834dea821cc4ea6ecc10a6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.550601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9c9dd337834dea821cc4ea6ecc10a6'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.562964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1337/2659] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:10 2022] DELETE /identity/v3/users/dc9c9dd337834dea821cc4ea6ecc10a6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:10.753942 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:10.768954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca847a7-1be1-4dc2-9958-4069be36b4c4 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:10.841804 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:10.852513 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:10.852843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:10.853423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] PATH_INFO: `/v3/projects/df984bae4f4e4d01ac06870bee8a73bf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:10.855192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df984bae4f4e4d01ac06870bee8a73bf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:10.857342 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:10.908725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df984bae4f4e4d01ac06870bee8a73bf', 'request_id': 'req-ff4e1e3f-c50b-491b-9755-3a511161d1a6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.914802 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df984bae4f4e4d01ac06870bee8a73bf', 'request_id': 'req-ff4e1e3f-c50b-491b-9755-3a511161d1a6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.923508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df984bae4f4e4d01ac06870bee8a73bf', 'request_id': 'req-ff4e1e3f-c50b-491b-9755-3a511161d1a6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.934206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] The token cache is being invalidate because project df984bae4f4e4d01ac06870bee8a73bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:10.934494 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.935112 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:10.936819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1323/2660] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:10 2022] DELETE /identity/v3/projects/df984bae4f4e4d01ac06870bee8a73bf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:27:10.940759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:10.942199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:10.955683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742929-b8a8-4d4d-b08a-60ecb7697c0b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:11.016806 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:11.017716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:11.018006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:11.018287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] PATH_INFO: `/v3/users/5a10006c34894a1ebac9d75b1a19e8f9` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:11.019535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a10006c34894a1ebac9d75b1a19e8f9)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:11.021551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:11.070484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a10006c34894a1ebac9d75b1a19e8f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.077200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a10006c34894a1ebac9d75b1a19e8f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.081518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:11.091003 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a10006c34894a1ebac9d75b1a19e8f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.091729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a10006c34894a1ebac9d75b1a19e8f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.099879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a10006c34894a1ebac9d75b1a19e8f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.106822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1338/2661] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:10 2022] DELETE /identity/v3/users/5a10006c34894a1ebac9d75b1a19e8f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:11.284192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:11.285777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:11.299418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1e3f-c50b-491b-9755-3a511161d1a6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:11.362958 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:11.363856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:11.364258 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:11.364559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] PATH_INFO: `/v3/projects/a886bc50cd744119b6eddf9d71f2c7ae` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:11.366098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a886bc50cd744119b6eddf9d71f2c7ae)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:11.368072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:11.390425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:11.417517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a886bc50cd744119b6eddf9d71f2c7ae', 'request_id': 'req-b64e7bbf-1d09-44e1-9906-499f65dfeeef'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.423664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a886bc50cd744119b6eddf9d71f2c7ae', 'request_id': 'req-b64e7bbf-1d09-44e1-9906-499f65dfeeef'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.432297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a886bc50cd744119b6eddf9d71f2c7ae', 'request_id': 'req-b64e7bbf-1d09-44e1-9906-499f65dfeeef'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.444381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] The token cache is being invalidate because project a886bc50cd744119b6eddf9d71f2c7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:11.444706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.445437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:11.447115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1324/2662] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:11 2022] DELETE /identity/v3/projects/a886bc50cd744119b6eddf9d71f2c7ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:21.103355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:21.441131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:47.801555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:47.803118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:47.860144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88200-03ea-40ec-bb22-63c479acc3d6 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:47.910683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:47.911394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:47.911679 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:47.912040 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:47.913936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:47.987917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:47.989428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:48.000635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1339/2663] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:27:50.631486 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:50.633529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:50.700223 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e7bbf-1d09-44e1-9906-499f65dfeeef admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:50.705421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:50.706314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:50.706607 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:50.706883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] PATH_INFO: `/v3/users/6943ae00467244228fa6ac90e48c4cce` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:50.708109 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6943ae00467244228fa6ac90e48c4cce)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:50.710165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:50.760035 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6943ae00467244228fa6ac90e48c4cce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:50.760749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6943ae00467244228fa6ac90e48c4cce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:50.775250 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6943ae00467244228fa6ac90e48c4cce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:50.784751 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6943ae00467244228fa6ac90e48c4cce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:50.785497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-38f98471-0ebf-4de9-ba82-efc5f7703c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6943ae00467244228fa6ac90e48c4cce'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:50.798863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1325/2664] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:50 2022] DELETE /identity/v3/users/6943ae00467244228fa6ac90e48c4cce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:50.981461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:50.992537 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5663-be7c-4b82-9fd8-8fe8b6e9fac2 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.046499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:51.052982 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.053921 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.054202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.054477 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] PATH_INFO: `/v3/projects/054a5a15ef3c4200b1a78a890b077a53` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.055659 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054a5a15ef3c4200b1a78a890b077a53)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.057647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.105343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054a5a15ef3c4200b1a78a890b077a53', 'request_id': 'req-2607c97c-7a19-4564-aeb9-b115312f7cb1'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:51.114460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054a5a15ef3c4200b1a78a890b077a53', 'request_id': 'req-2607c97c-7a19-4564-aeb9-b115312f7cb1'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:51.120859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054a5a15ef3c4200b1a78a890b077a53', 'request_id': 'req-2607c97c-7a19-4564-aeb9-b115312f7cb1'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:51.131018 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] The token cache is being invalidate because project 054a5a15ef3c4200b1a78a890b077a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:51.131357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:51.132016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2607c97c-7a19-4564-aeb9-b115312f7cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:51.133602 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1340/2665] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:50 2022] DELETE /identity/v3/projects/054a5a15ef3c4200b1a78a890b077a53 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:51.139105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.139395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.139673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.158111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:51.159334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:51.230906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1326/2666] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:51.239141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.239432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.239712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.260250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:51.261870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:51.271366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1341/2667] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:51.275787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.285966 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb5cb-4ae1-42ea-a692-072299e60752 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.292362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.293530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.293880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.294257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.295393 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:27:51.295805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.298379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.315978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1327/2668] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:27:51.320485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.330318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482a5cd-e152-4257-b092-ebb18874f414 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.336359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.337079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.337371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.337639 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.338328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.340273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.370739 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1342/2669] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:51.374884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.385269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276a30-6161-4da4-b299-e370c7fe068b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.389611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:51.448037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.448763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.449052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.449330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.450018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.451956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.471883 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1328/2670] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:51.476041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.486245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ea2b6-132d-42b5-940f-0e6b7b04a2d9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.490960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.491628 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.491909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.492182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.492940 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.494565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.505409 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1343/2671] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:27:51.509334 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.520728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b85d8d-8d39-403a-ada1-69fb6104063a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.526724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74271b92-933e-4b58-9cdf-4468caeef7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.527403 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271b92-933e-4b58-9cdf-4468caeef7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.527695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271b92-933e-4b58-9cdf-4468caeef7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.527997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271b92-933e-4b58-9cdf-4468caeef7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.528786 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74271b92-933e-4b58-9cdf-4468caeef7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.530417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74271b92-933e-4b58-9cdf-4468caeef7d8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.541167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1329/2672] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:27:51.545305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.556521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e7aa-95e3-4aa2-9a4a-eb810e08b983 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.561654 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.562581 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.562866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.563145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] PATH_INFO: `/v3/projects/ee9300ef02f14fb6a072431d581f2a8b/users/a0639a4f454d4cd19e838e7bc2155403/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.578312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9300ef02f14fb6a072431d581f2a8b, user_id=a0639a4f454d4cd19e838e7bc2155403, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.581053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.596561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1344/2673] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:51 2022] PUT /identity/v3/projects/ee9300ef02f14fb6a072431d581f2a8b/users/a0639a4f454d4cd19e838e7bc2155403/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:51.606618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.606888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.607182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.633672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] MFA Rules not processed for user `a0639a4f454d4cd19e838e7bc2155403`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:51.634797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:51.699411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1330/2674] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:51.704098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.778343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb6df-fbce-449d-b430-fa80a5deaea1 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.784276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.784988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.785275 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.785554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.786383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.788490 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.826509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1345/2675] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:51.830756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.842260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bedf4-8724-499f-9988-acb095f210f0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.899800 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.900537 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.900860 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.901141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.901821 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.903805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.925620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1331/2676] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:27:51 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:51.929380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.939990 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ffd6b-41c0-4a09-8756-baca959950e2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.945878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.946570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.946879 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.947218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:51.947964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:51.949553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:51.952412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:51.963710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1346/2677] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:27:51.967715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:51.975056 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:51.979244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e22e42-c213-41f6-bc5e-bfd5e25f3d5f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:51.985210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:51.986274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:51.986568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:51.986851 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] PATH_INFO: `/v3/projects/94b3c9252bfd40a99f892a67a5f42823/users/6fe5d5c5e99442c1aa75c008c3bc5fcf/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.003587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b3c9252bfd40a99f892a67a5f42823, user_id=6fe5d5c5e99442c1aa75c008c3bc5fcf, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:52.006556 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:52.022599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1332/2678] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:51 2022] PUT /identity/v3/projects/94b3c9252bfd40a99f892a67a5f42823/users/6fe5d5c5e99442c1aa75c008c3bc5fcf/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:27:52.026705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:52.037903 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9760-328e-4803-9ac1-a935c46dabea admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:52.098579 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4764c-6815-4123-82c0-193992039d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:52.099260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4764c-6815-4123-82c0-193992039d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.099549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4764c-6815-4123-82c0-193992039d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.099829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4764c-6815-4123-82c0-193992039d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.100717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4764c-6815-4123-82c0-193992039d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:52.102286 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4764c-6815-4123-82c0-193992039d34 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:52.112814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1347/2679] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:27:52.117910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:52.128781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ceaa3-f324-4b71-8fa7-0a0dcbcca9d3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:52.133761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:52.134662 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.134944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.135219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] PATH_INFO: `/v3/projects/94b3c9252bfd40a99f892a67a5f42823/users/6fe5d5c5e99442c1aa75c008c3bc5fcf/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.137836 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b3c9252bfd40a99f892a67a5f42823, user_id=6fe5d5c5e99442c1aa75c008c3bc5fcf, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:52.141478 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:52.155889 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1333/2680] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:52 2022] PUT /identity/v3/projects/94b3c9252bfd40a99f892a67a5f42823/users/6fe5d5c5e99442c1aa75c008c3bc5fcf/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:27:52.167520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.167825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.168088 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.195586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] MFA Rules not processed for user `6fe5d5c5e99442c1aa75c008c3bc5fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:52.196841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:52.269270 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1348/2681] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:27:52.280622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:52.282418 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:52.341781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ee45-c146-45ab-8f45-9dc17e0f7e93 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:52.346322 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1d6c-2e35-43cf-a707-21808192eede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:52.346996 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1d6c-2e35-43cf-a707-21808192eede service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.347287 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1d6c-2e35-43cf-a707-21808192eede service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.347587 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1d6c-2e35-43cf-a707-21808192eede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.357549 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1d6c-2e35-43cf-a707-21808192eede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:52.359019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1d6c-2e35-43cf-a707-21808192eede service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:52.369367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1334/2682] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:27:52.503093 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:52.574934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2573d-934b-427e-88f7-429dbe6536cc None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:52.579795 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:52.580794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.581107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.581383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] PATH_INFO: `/v3/users/a0639a4f454d4cd19e838e7bc2155403` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.582586 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0639a4f454d4cd19e838e7bc2155403)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:52.584584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:52.608449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:52.636731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0639a4f454d4cd19e838e7bc2155403'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:52.643708 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0639a4f454d4cd19e838e7bc2155403'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:52.656150 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0639a4f454d4cd19e838e7bc2155403'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:52.656880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0639a4f454d4cd19e838e7bc2155403'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:52.669387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0639a4f454d4cd19e838e7bc2155403'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:52.677301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1349/2683] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:52 2022] DELETE /identity/v3/users/a0639a4f454d4cd19e838e7bc2155403 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:52.684369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.685093 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.685276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.707121 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:52.708357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:52.769280 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1335/2684] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:52.779182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:52.780863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:52.839793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a7f5a-d4fb-4fc3-860d-5a9c60ec0b1c admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:52.843752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:52.844405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:52.844736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:52.845006 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:52.854505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:52.855958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:52.865547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1350/2685] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:27:53.147265 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:53.148850 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:53.164778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddab62-4a23-4b77-b3fb-864049f75c1c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:53.169954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:53.170849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:53.171062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:53.171336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] PATH_INFO: `/v3/projects/ee9300ef02f14fb6a072431d581f2a8b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:53.172545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9300ef02f14fb6a072431d581f2a8b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:53.174516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:53.223378 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9300ef02f14fb6a072431d581f2a8b', 'request_id': 'req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.229529 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9300ef02f14fb6a072431d581f2a8b', 'request_id': 'req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.238271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9300ef02f14fb6a072431d581f2a8b', 'request_id': 'req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.242927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:53.254965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] The token cache is being invalidate because project ee9300ef02f14fb6a072431d581f2a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:53.255354 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.256349 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.258882 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1336/2686] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:53 2022] DELETE /identity/v3/projects/ee9300ef02f14fb6a072431d581f2a8b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:53.263383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:53.277268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c503e0-6f7a-41f0-b169-f9f453a5f8f1 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:53.349418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:53.350468 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:53.350777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:53.351038 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] PATH_INFO: `/v3/users/6fe5d5c5e99442c1aa75c008c3bc5fcf` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:53.352260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe5d5c5e99442c1aa75c008c3bc5fcf)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:53.354273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:53.402880 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:53.405979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe5d5c5e99442c1aa75c008c3bc5fcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.414326 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe5d5c5e99442c1aa75c008c3bc5fcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.426414 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe5d5c5e99442c1aa75c008c3bc5fcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.427114 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe5d5c5e99442c1aa75c008c3bc5fcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.435819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-18c16a1b-0e0e-4c00-ab93-872d3a2b3532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe5d5c5e99442c1aa75c008c3bc5fcf'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.441901 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1351/2687] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:53 2022] DELETE /identity/v3/users/6fe5d5c5e99442c1aa75c008c3bc5fcf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:53.726308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:53.727967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:53.742114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead3a6-03c4-46f7-b2dc-fd8448142ea3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:53.813000 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:53.813895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:53.814179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:53.814460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] PATH_INFO: `/v3/projects/94b3c9252bfd40a99f892a67a5f42823` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:53.815692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b3c9252bfd40a99f892a67a5f42823)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:53.817703 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:53.865813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b3c9252bfd40a99f892a67a5f42823', 'request_id': 'req-b9532a87-d944-4610-ad7b-60c00d50621c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.871924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b3c9252bfd40a99f892a67a5f42823', 'request_id': 'req-b9532a87-d944-4610-ad7b-60c00d50621c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.881451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b3c9252bfd40a99f892a67a5f42823', 'request_id': 'req-b9532a87-d944-4610-ad7b-60c00d50621c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.892304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] The token cache is being invalidate because project 94b3c9252bfd40a99f892a67a5f42823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:53.892592 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.893231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9532a87-d944-4610-ad7b-60c00d50621c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:53.895157 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1337/2688] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:53 2022] DELETE /identity/v3/projects/94b3c9252bfd40a99f892a67a5f42823 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:53.899917 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:53.900238 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:53.900522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:53.918752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:53.919964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:53.982487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1352/2689] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:53.990387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:53.990741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:53.991052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.009791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:54.011042 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:54.021279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1338/2690] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:54.027864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.043436 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4e5c9-938e-49dd-9fc5-fb3ccdb9e450 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.050779 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.051651 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.052064 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.052450 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.053503 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:27:54.053840 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.055486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.067633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1353/2691] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:27:54.072135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.081684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a92ec-4713-4624-b826-aa3ff1989b45 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.087363 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.088022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.088329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.088590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.089311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.091241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.118988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1339/2692] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:27:54 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:54.123474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.134054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ee1d-5616-48a1-9c5d-952f4fcf29c5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.195964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.196643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.196949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.197229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.197945 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.199930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.226972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1354/2693] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:27:54 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:27:54.228261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.239417 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174227d-e655-40e5-9f60-64cab3f40abb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.248126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.248891 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.249327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.249613 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.250358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.252248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.266834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1340/2694] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:27:54.268053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.278634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fd594-06d3-408a-9476-0aedfb13e3e6 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.283699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68ed3-d404-45dc-942f-6e060740f091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.284380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68ed3-d404-45dc-942f-6e060740f091 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.284698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68ed3-d404-45dc-942f-6e060740f091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.284981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68ed3-d404-45dc-942f-6e060740f091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.285736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f68ed3-d404-45dc-942f-6e060740f091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.287413 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f68ed3-d404-45dc-942f-6e060740f091 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.297650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1355/2695] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:27:54.301950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.312261 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f071c7-546c-49e6-8f30-61ca3af54d5a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.317823 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.318965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.319277 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.319554 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] PATH_INFO: `/v3/projects/83c506a67bf84176ab9d8423794dcbde/users/40bb1d86de8846c9991a46605a97c5ec/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.335754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c506a67bf84176ab9d8423794dcbde, user_id=40bb1d86de8846c9991a46605a97c5ec, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.338478 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.353542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1341/2696] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:54 2022] PUT /identity/v3/projects/83c506a67bf84176ab9d8423794dcbde/users/40bb1d86de8846c9991a46605a97c5ec/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:54.365265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.365700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.365971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.396873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] MFA Rules not processed for user `40bb1d86de8846c9991a46605a97c5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:54.398086 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:54.410495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:54.465964 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1356/2697] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:54.472234 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.495236 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:54.540586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a8d8-1788-40ff-a52f-b56b9d3a21f1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.546177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.547053 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.547416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.547831 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.548628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.550696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.579536 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1342/2698] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:27:54 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:27:54.583534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.596859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b28ad-316d-41f0-a33a-2bcbb4005fd4 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.656478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.657223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.657507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.657784 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.658483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.660432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.682125 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1357/2699] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:27:54 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:54.685809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.696595 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269b3f-e9d1-4bbd-86be-0f19d5a4ecd3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.701563 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.702315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.702616 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.702884 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.703622 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.705267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.717655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1343/2700] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:27:54.722394 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.734572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558226fe-c9c7-4aed-9cea-8700b3b954df admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.739817 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.740808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.741103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.741385 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] PATH_INFO: `/v3/projects/4614c70e6f414828a8492a114ec1b70e/users/72ba9d56a73a4defbc653138aefee4d0/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.747451 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.749248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:54.757831 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4614c70e6f414828a8492a114ec1b70e, user_id=72ba9d56a73a4defbc653138aefee4d0, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.760551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.774787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1358/2701] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:54 2022] PUT /identity/v3/projects/4614c70e6f414828a8492a114ec1b70e/users/72ba9d56a73a4defbc653138aefee4d0/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:54.778662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.806906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde97c4-4480-4c14-8cb4-e81171fad46a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.844885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff960066-4a4d-4c76-a6a2-918a80ffa0d4 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.850803 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.851525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.851783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.852065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.852843 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.854543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.856491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.857522 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.857816 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.858099 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.860348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:54.864632 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1359/2702] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:27:54.868750 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:54.878102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377569a3-fc14-44fe-a4e5-4a7e093fcd30 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:54.883267 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc705901-8831-4d00-9e22-d01ce0cc5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:54.884165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705901-8831-4d00-9e22-d01ce0cc5d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.884453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705901-8831-4d00-9e22-d01ce0cc5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.884771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705901-8831-4d00-9e22-d01ce0cc5d76 admin admin] PATH_INFO: `/v3/projects/4614c70e6f414828a8492a114ec1b70e/users/72ba9d56a73a4defbc653138aefee4d0/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.887131 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc705901-8831-4d00-9e22-d01ce0cc5d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4614c70e6f414828a8492a114ec1b70e, user_id=72ba9d56a73a4defbc653138aefee4d0, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.889859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc705901-8831-4d00-9e22-d01ce0cc5d76 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.900300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1360/2703] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:54 2022] PUT /identity/v3/projects/4614c70e6f414828a8492a114ec1b70e/users/72ba9d56a73a4defbc653138aefee4d0/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:27:54.910513 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:54.910810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:54.911099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:54.918217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:54.924071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:54.939252 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:54.940573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] MFA Rules not processed for user `72ba9d56a73a4defbc653138aefee4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:54.940796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:54.941819 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:54.952640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1344/2704] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:27:55.012025 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1361/2705] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:27:55.022541 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:55.024391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:55.037756 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a658-126b-4f31-8715-a64c4f08db32 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:55.092695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:55.093686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:55.094478 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:55.094878 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:55.105141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:55.106577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:55.117640 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1345/2706] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:27:55.193777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:55.203811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec15b-353f-42e8-971d-0d6e8ce8d82e None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:55.207565 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980259a-8605-4c15-b410-c93a0f610d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:55.208223 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980259a-8605-4c15-b410-c93a0f610d23 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:55.208509 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980259a-8605-4c15-b410-c93a0f610d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:55.208825 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980259a-8605-4c15-b410-c93a0f610d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:55.269941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980259a-8605-4c15-b410-c93a0f610d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:55.271440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980259a-8605-4c15-b410-c93a0f610d23 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:55.281302 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1362/2707] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:27:58.016105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:58.080918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea781169-4a07-4e5f-aadb-e9ac0a7f8d1b service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:58.085626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:58.086516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:58.086796 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:58.087069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] PATH_INFO: `/v3/users/40bb1d86de8846c9991a46605a97c5ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:58.088293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bb1d86de8846c9991a46605a97c5ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:58.090307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:58.149917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bb1d86de8846c9991a46605a97c5ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.150517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bb1d86de8846c9991a46605a97c5ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.163060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bb1d86de8846c9991a46605a97c5ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.171840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bb1d86de8846c9991a46605a97c5ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.172523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bb1d86de8846c9991a46605a97c5ec'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.186117 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1346/2708] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:58 2022] DELETE /identity/v3/users/40bb1d86de8846c9991a46605a97c5ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:58.190723 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:58.191228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:58.191424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:58.208969 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:58.210319 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:58.271925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1363/2709] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:27:58.281813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:58.283344 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:58.298937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:58.345725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896828f0-2731-4bf9-8c11-bc5b0ed69be4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:58.351130 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:58.351814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:58.352100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:58.352376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:58.362415 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:58.364004 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:58.376408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1347/2710] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:27:58.667405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:58.669264 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:58.682677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a9378-7c97-4694-9c47-e184b39ad4a2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:58.687711 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:58.688820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:58.689299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:58.689584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] PATH_INFO: `/v3/projects/83c506a67bf84176ab9d8423794dcbde` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:58.690955 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c506a67bf84176ab9d8423794dcbde)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:58.693144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:58.721636 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:58.746142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c506a67bf84176ab9d8423794dcbde', 'request_id': 'req-eb831d4c-44ec-4d38-8cf3-31277ea4df02'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.755393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c506a67bf84176ab9d8423794dcbde', 'request_id': 'req-eb831d4c-44ec-4d38-8cf3-31277ea4df02'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.762707 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c506a67bf84176ab9d8423794dcbde', 'request_id': 'req-eb831d4c-44ec-4d38-8cf3-31277ea4df02'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.773790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] The token cache is being invalidate because project 83c506a67bf84176ab9d8423794dcbde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:58.774084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.774771 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.776392 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1364/2711] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:58 2022] DELETE /identity/v3/projects/83c506a67bf84176ab9d8423794dcbde => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:58.780469 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:58.791184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736192ce-ffeb-484a-b5dc-9ccb88106b2d service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:58.861551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:58.862553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:58.862941 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:58.863267 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] PATH_INFO: `/v3/users/72ba9d56a73a4defbc653138aefee4d0` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:58.864509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ba9d56a73a4defbc653138aefee4d0)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:58.866591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:58.964515 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ba9d56a73a4defbc653138aefee4d0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.965635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ba9d56a73a4defbc653138aefee4d0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:58.988063 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ba9d56a73a4defbc653138aefee4d0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.000652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ba9d56a73a4defbc653138aefee4d0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.002963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9ac38b3-8754-4f26-a28e-61ba03fe03ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ba9d56a73a4defbc653138aefee4d0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.021437 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1348/2712] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:27:58 2022] DELETE /identity/v3/users/72ba9d56a73a4defbc653138aefee4d0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:59.321777 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.323402 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:59.341684 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb831d4c-44ec-4d38-8cf3-31277ea4df02 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.407552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.409152 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.409446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.409727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] PATH_INFO: `/v3/projects/4614c70e6f414828a8492a114ec1b70e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.411051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4614c70e6f414828a8492a114ec1b70e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.413243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.466738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4614c70e6f414828a8492a114ec1b70e', 'request_id': 'req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.475884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4614c70e6f414828a8492a114ec1b70e', 'request_id': 'req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.483073 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4614c70e6f414828a8492a114ec1b70e', 'request_id': 'req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.495298 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] The token cache is being invalidate because project 4614c70e6f414828a8492a114ec1b70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:27:59.496209 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.496937 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-9b212fdd-2b10-4ebb-bb23-e9c15b890b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:27:59.498549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1365/2713] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:27:59 2022] DELETE /identity/v3/projects/4614c70e6f414828a8492a114ec1b70e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:59.505844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.506255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.506548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.526998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:59.528293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:59.560910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:59.592501 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1349/2714] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:27:59.600583 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.600906 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.601246 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.620745 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:59.622316 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:27:59.630343 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1366/2715] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:27:59.634795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.645826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c260e0-d304-4aff-a728-4f0e235d7298 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.650630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.651309 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.651665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.651954 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.652749 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:27:59.653182 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.655078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.668308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1350/2716] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:27:59.672514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.683058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44101ea1-efd3-42b0-b8a4-16efb65812fb None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.688153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.688919 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.689203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.689483 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.690185 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.692124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.723661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1367/2717] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:27:59 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:59.724812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.736171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091eebc-fe2e-4d1c-a97c-56be32443a03 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.796360 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.797104 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.797387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.797668 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.798380 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.800519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.823531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1351/2718] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:27:59 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:27:59.827796 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.838514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45984aa-a580-4cad-a7d9-1b82f5361db2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.843117 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.843793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.844077 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.844355 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.845119 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.846747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.857287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1368/2719] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:27:59.861364 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.872235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888dd29-3d8f-4801-85c9-7b1dad2590ba admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.877398 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d6f6e-8a3d-406c-902f-db2ccb65c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.878096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6f6e-8a3d-406c-902f-db2ccb65c1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.878384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6f6e-8a3d-406c-902f-db2ccb65c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.878809 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6f6e-8a3d-406c-902f-db2ccb65c1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.879553 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d6f6e-8a3d-406c-902f-db2ccb65c1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.881276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d6f6e-8a3d-406c-902f-db2ccb65c1c4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.892531 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1352/2720] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:27:59.896975 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:27:59.902300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:59.909079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d63c8-b8b9-4ce5-8b36-a2cede312bd0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:27:59.915147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:27:59.916082 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.916375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.916680 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] PATH_INFO: `/v3/projects/d886f18754644803ba4bc6126f61cc5e/users/3ac5e1c928e34534965c3299ae05cded/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.931446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d886f18754644803ba4bc6126f61cc5e, user_id=3ac5e1c928e34534965c3299ae05cded, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:27:59.935029 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:27:59.950440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1369/2721] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:27:59 2022] PUT /identity/v3/projects/d886f18754644803ba4bc6126f61cc5e/users/3ac5e1c928e34534965c3299ae05cded/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:27:59.962062 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:27:59.962369 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:27:59.962673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:27:59.989888 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] MFA Rules not processed for user `3ac5e1c928e34534965c3299ae05cded`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:27:59.991162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:00.054936 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1353/2722] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:00.059618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.131546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5037c-bcdb-4593-a67e-545fc54d1316 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.139930 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.141138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.141649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.142139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.143095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.145715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.174476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1370/2723] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:28:00 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:28:00.179037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.190982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72c36-49d6-4cce-a28a-84fec107bf73 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.221015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:00.268315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.269748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.270045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.271126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.272085 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.274702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.300900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1354/2724] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:28:00 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:28:00.304765 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.316087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677295a2-c0c7-4bbb-9ce7-48920b564762 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.321241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.322095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.322694 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.322884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.323858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.325604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.337543 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1371/2725] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:28:00.341661 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.353763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fb8cf-d08b-4172-8f47-6209b74a0ba7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.358805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.359728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.360122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.360416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] PATH_INFO: `/v3/projects/8632a28c6c39453c966b199a6647610e/users/c2a97c978dc345589dd6d35d4c37a31e/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.377228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8632a28c6c39453c966b199a6647610e, user_id=c2a97c978dc345589dd6d35d4c37a31e, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.380637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.395086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1355/2726] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:28:00 2022] PUT /identity/v3/projects/8632a28c6c39453c966b199a6647610e/users/c2a97c978dc345589dd6d35d4c37a31e/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:00.399113 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.410821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db43f4-7f4a-4b6b-9496-49f9799a83e0 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.472056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a2ffc-f3b2-443f-a0d7-0a4be5fafed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.472794 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2ffc-f3b2-443f-a0d7-0a4be5fafed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.473080 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2ffc-f3b2-443f-a0d7-0a4be5fafed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.473354 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2ffc-f3b2-443f-a0d7-0a4be5fafed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.474084 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a2ffc-f3b2-443f-a0d7-0a4be5fafed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.475744 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a2ffc-f3b2-443f-a0d7-0a4be5fafed2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.486200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1372/2727] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:28:00.490282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.501013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c2d9-5f64-4ed1-a8ab-8c5881351fed admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.505637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.506571 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.506864 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.507146 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] PATH_INFO: `/v3/projects/8632a28c6c39453c966b199a6647610e/users/c2a97c978dc345589dd6d35d4c37a31e/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.509171 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8632a28c6c39453c966b199a6647610e, user_id=c2a97c978dc345589dd6d35d4c37a31e, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.512244 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.522879 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1356/2728] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:28:00 2022] PUT /identity/v3/projects/8632a28c6c39453c966b199a6647610e/users/c2a97c978dc345589dd6d35d4c37a31e/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:00.534461 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.534752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.535027 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.563596 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] MFA Rules not processed for user `c2a97c978dc345589dd6d35d4c37a31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:00.564861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:00.606584 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:00.640200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1373/2729] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:00.651390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:00.653209 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:00.718255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a9d42-ed7d-4427-aee7-48beff57fff7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:00.723391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849b08-bd4c-4974-93bd-4019770a2fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:00.724126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849b08-bd4c-4974-93bd-4019770a2fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:00.724412 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849b08-bd4c-4974-93bd-4019770a2fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:00.724733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849b08-bd4c-4974-93bd-4019770a2fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:00.735059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9849b08-bd4c-4974-93bd-4019770a2fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:00.736734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9849b08-bd4c-4974-93bd-4019770a2fc6 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:00.747582 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1357/2730] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:01.122180 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:01.186230 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2407-5e77-45a7-a763-008f9055c6e2 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:01.191068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:01.192079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:01.192273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:01.192484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] PATH_INFO: `/v3/users/3ac5e1c928e34534965c3299ae05cded` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:01.193815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac5e1c928e34534965c3299ae05cded)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:01.195776 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:01.247087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac5e1c928e34534965c3299ae05cded'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.254181 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac5e1c928e34534965c3299ae05cded'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.266855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac5e1c928e34534965c3299ae05cded'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.267564 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac5e1c928e34534965c3299ae05cded'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.277053 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac5e1c928e34534965c3299ae05cded'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.283789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1374/2731] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:28:01 2022] DELETE /identity/v3/users/3ac5e1c928e34534965c3299ae05cded => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:01.288555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:01.289065 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:01.289177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:01.307055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:01.308276 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:01.370224 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1358/2732] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:28:01.380382 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:01.381869 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:01.440956 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfefbfa-539a-4770-a3a1-449c6cc98973 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:01.445062 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:01.445736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:01.446024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:01.446299 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:01.453918 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:01.456727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:01.459390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:01.470662 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1375/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:01.752498 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:01.754371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:01.767328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0092c47-03c8-4676-83da-797a9e77be25 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:01.774840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:01.775714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:01.776008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:01.776281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] PATH_INFO: `/v3/projects/d886f18754644803ba4bc6126f61cc5e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:01.777565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d886f18754644803ba4bc6126f61cc5e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:01.779516 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:01.809899 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:01.834319 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd886f18754644803ba4bc6126f61cc5e', 'request_id': 'req-cd990c42-e2de-4aad-b8f6-c374384318c6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.840547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd886f18754644803ba4bc6126f61cc5e', 'request_id': 'req-cd990c42-e2de-4aad-b8f6-c374384318c6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.848116 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd886f18754644803ba4bc6126f61cc5e', 'request_id': 'req-cd990c42-e2de-4aad-b8f6-c374384318c6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.859623 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] The token cache is being invalidate because project d886f18754644803ba4bc6126f61cc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:28:01.859912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.860988 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-cd990c42-e2de-4aad-b8f6-c374384318c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.862538 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1359/2734] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:28:01 2022] DELETE /identity/v3/projects/d886f18754644803ba4bc6126f61cc5e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:01.866357 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:01.876633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ef0a8-d42c-4e85-a02d-1fac920bf900 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:01.935273 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:01.936176 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:01.936469 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:01.936780 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] PATH_INFO: `/v3/users/c2a97c978dc345589dd6d35d4c37a31e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:01.938020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a97c978dc345589dd6d35d4c37a31e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:01.939951 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:01.988200 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a97c978dc345589dd6d35d4c37a31e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:01.995624 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a97c978dc345589dd6d35d4c37a31e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.009133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a97c978dc345589dd6d35d4c37a31e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.010017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a97c978dc345589dd6d35d4c37a31e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.019938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a97c978dc345589dd6d35d4c37a31e'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.027278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1376/2735] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:28:01 2022] DELETE /identity/v3/users/c2a97c978dc345589dd6d35d4c37a31e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:28:02.039454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f5371-c679-4c3d-a378-c8a0aa8b9910 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.039746 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f5371-c679-4c3d-a378-c8a0aa8b9910 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.040014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f5371-c679-4c3d-a378-c8a0aa8b9910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.058493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-113f5371-c679-4c3d-a378-c8a0aa8b9910 None None] MFA Rules not processed for user `b4780bb497234a249b6d23afdab14370`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:02.059873 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-113f5371-c679-4c3d-a378-c8a0aa8b9910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:02.119568 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1360/2736] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:02.317420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.319700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:02.393836 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09910953-f33e-4e23-af29-adfe4e44ba23 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.398516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.399415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.399690 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.399963 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] PATH_INFO: `/v3/projects/8632a28c6c39453c966b199a6647610e` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.401189 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8632a28c6c39453c966b199a6647610e)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.403137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.420278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:02.454712 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8632a28c6c39453c966b199a6647610e', 'request_id': 'req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.462637 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8632a28c6c39453c966b199a6647610e', 'request_id': 'req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.469398 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8632a28c6c39453c966b199a6647610e', 'request_id': 'req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.480136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] The token cache is being invalidate because project 8632a28c6c39453c966b199a6647610e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:28:02.480428 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.481115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-cdf38c1b-2ee4-493a-a6b5-e927f19955e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:02.482671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1377/2737] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:28:02 2022] DELETE /identity/v3/projects/8632a28c6c39453c966b199a6647610e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:28:02.487715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.488177 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.488271 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.506528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:02.512511 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:02.578286 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1361/2738] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:02.586393 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.586858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.587141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.606888 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:02.608107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:02.617262 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1378/2739] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:02.621411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.631768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42599b0-7f22-44c1-995c-17673abb2726 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.637432 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.638115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.638404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.638684 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.639476 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:28:02.639790 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.641694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.654963 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1362/2740] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:28:02.659366 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.669013 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709efcaa-4c9a-4445-a182-e82667538423 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.674192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.674857 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.675146 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.675427 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.676118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.678128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.712999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1379/2741] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:28:02 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:28:02.714379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.724716 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3c56-b4e8-4350-aa74-eb3f53a16135 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.775975 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:02.805705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.806525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.806898 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.807532 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.808512 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.810862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.840853 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1363/2742] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:28:02 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:28:02.842269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.853471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831cff4-bea8-43e5-be00-458a15ae04a3 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.858465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.859145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.859456 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.859698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.860437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.862154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.873801 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1380/2743] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:28:02.877928 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.889159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12ab6-cbbf-482c-955f-16dee07fa358 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.894071 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd57ad-1efc-42a1-8958-c9c541b307e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.894871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd57ad-1efc-42a1-8958-c9c541b307e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.895233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd57ad-1efc-42a1-8958-c9c541b307e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.895577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd57ad-1efc-42a1-8958-c9c541b307e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.896379 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd57ad-1efc-42a1-8958-c9c541b307e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.898120 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd57ad-1efc-42a1-8958-c9c541b307e6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.910206 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1364/2744] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:28:02.914527 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:02.924877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659f20c-3469-4baa-9314-406d14bb210f admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:02.930418 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:02.931471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.931746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.932138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] PATH_INFO: `/v3/projects/67656c3c471246c0a78d649cec0f5794/users/d43e145f436b4b9a8e96796f65b1b114/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:02.950072 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67656c3c471246c0a78d649cec0f5794, user_id=d43e145f436b4b9a8e96796f65b1b114, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:02.952826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:02.970118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1381/2745] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:28:02 2022] PUT /identity/v3/projects/67656c3c471246c0a78d649cec0f5794/users/d43e145f436b4b9a8e96796f65b1b114/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:02.982172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5300-7073-4adb-bdfa-7282b50b39fa None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:02.982470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5300-7073-4adb-bdfa-7282b50b39fa None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:02.982753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5300-7073-4adb-bdfa-7282b50b39fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:03.012097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e11c5300-7073-4adb-bdfa-7282b50b39fa None None] MFA Rules not processed for user `d43e145f436b4b9a8e96796f65b1b114`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:03.013438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e11c5300-7073-4adb-bdfa-7282b50b39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:03.082452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1365/2746] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:03.094752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:03.096714 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:03.158070 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b857b-e57e-4ece-b54f-03238c62edc1 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:03.162622 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:03.163349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:03.163686 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:03.164024 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:03.173666 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:03.175133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:03.184770 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1382/2747] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:28:04.564039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:04.564777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:04.564777 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:04.585105 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] MFA Rules not processed for user `d43e145f436b4b9a8e96796f65b1b114`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:04.586440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:04.600404 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1366/2748] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:04.666535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:04.668071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:04.722268 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:04.737643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187231d2-59b9-4b8a-9841-80ed204d29e4 service cinder] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:04.742085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:04.743733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:04.743733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:04.743733 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:04.745475 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:04.756305 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:04.757756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0b530-7804-4d91-8dd6-4b42fc401875 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:04.767010 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1383/2749] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:14.578471 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:14.763242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:14.888348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:14.890013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:14.998950 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0866f1f-e999-4595-b4b2-d672a7e1a320 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:15.005479 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:15.006149 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:15.006463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:15.006833 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:15.008779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:15.023696 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:15.026674 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:15.039339 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1367/2750] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:17.584419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525128d-3149-4cc6-8b75-e4a044fe653a None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:17.584878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525128d-3149-4cc6-8b75-e4a044fe653a None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:17.584996 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525128d-3149-4cc6-8b75-e4a044fe653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:17.602520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-c525128d-3149-4cc6-8b75-e4a044fe653a None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:17.603766 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-c525128d-3149-4cc6-8b75-e4a044fe653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:17.663944 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1384/2751] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:28:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:17.714083 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:17.715599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:17.787308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d316a-9e87-4272-8101-c74ac99ed4ec service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:17.793638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:17.794326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:17.794620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:17.794893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:17.804293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:17.805992 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:17.814410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1368/2752] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:28:18.327245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4603-3fb5-46d0-971b-42b46dd06f47 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:18.327618 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4603-3fb5-46d0-971b-42b46dd06f47 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:18.327908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4603-3fb5-46d0-971b-42b46dd06f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:18.346415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7f2c4603-3fb5-46d0-971b-42b46dd06f47 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:18.347614 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7f2c4603-3fb5-46d0-971b-42b46dd06f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:18.355716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1385/2753] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:18.368037 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:18.379019 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2cfb-80b7-4170-bc48-a36d095d46ac service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:18.385152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:18.385803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:18.386087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:18.386735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:18.395452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:18.397151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:18.405518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1369/2754] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:28:18.600118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d23ff-7f54-470f-9f28-e89946adb018 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:18.600691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d23ff-7f54-470f-9f28-e89946adb018 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:18.601065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d23ff-7f54-470f-9f28-e89946adb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:18.624314 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ce7d23ff-7f54-470f-9f28-e89946adb018 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:18.625931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ce7d23ff-7f54-470f-9f28-e89946adb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:18.634008 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1386/2755] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:18.650812 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:18.662740 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ce67-9afd-4d4d-9b7d-1659640449fe service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:18.668819 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:18.669470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:18.669758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:18.670038 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:18.678491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:18.680124 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:18.688387 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1370/2756] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 17:28:19.037312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:19.037608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:19.037891 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:19.055947 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] MFA Rules not processed for user `2f60f49044d04b0fb795873494fc8d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:19.057203 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:19.064878 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1387/2757] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 17:28:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:19.077389 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:19.088737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9409-e2c2-4454-bb2a-c74ead89ba62 service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:19.095766 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88a0fd-205e-4528-acf0-cc24fe587439 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4c03a473c84329a4d982ef47ea0e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:19.096421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a0fd-205e-4528-acf0-cc24fe587439 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:19.096743 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a0fd-205e-4528-acf0-cc24fe587439 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:19.097027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a0fd-205e-4528-acf0-cc24fe587439 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:19.106688 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88a0fd-205e-4528-acf0-cc24fe587439 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:19.109329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88a0fd-205e-4528-acf0-cc24fe587439 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:19.119575 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1371/2758] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 17:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:28:21.237516 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:21.305324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc399d-56a4-4475-8ea6-039496b873c1 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:21.310193 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:21.311083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:21.311365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:21.311638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] PATH_INFO: `/v3/users/d43e145f436b4b9a8e96796f65b1b114` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:21.312910 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43e145f436b4b9a8e96796f65b1b114)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:21.314859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:21.368108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43e145f436b4b9a8e96796f65b1b114'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.375136 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43e145f436b4b9a8e96796f65b1b114'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.388020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43e145f436b4b9a8e96796f65b1b114'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.388821 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43e145f436b4b9a8e96796f65b1b114'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.397412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43e145f436b4b9a8e96796f65b1b114'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.403534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1388/2759] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:28:21 2022] DELETE /identity/v3/users/d43e145f436b4b9a8e96796f65b1b114 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:21.409045 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:21.409533 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:21.409631 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:21.435331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:21.436534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:21.465467 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:21.498614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1372/2760] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:28:21.508340 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:21.509926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:21.517249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:21.569099 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d6554-1d37-4159-9295-ac63c4fcc847 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:21.574256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3c223-c384-40d2-8aec-f85c57989a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:21.574931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c223-c384-40d2-8aec-f85c57989a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:21.575195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c223-c384-40d2-8aec-f85c57989a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:21.575481 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c223-c384-40d2-8aec-f85c57989a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:21.586017 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3c223-c384-40d2-8aec-f85c57989a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:21.587560 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3c223-c384-40d2-8aec-f85c57989a37 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:21.597408 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1389/2761] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:21.770797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:21.772542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:21.790410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3975a9-ba40-4a08-ad34-1b7d88e5ced9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:21.799753 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:21.800907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:21.801229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:21.801555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] PATH_INFO: `/v3/projects/67656c3c471246c0a78d649cec0f5794` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:21.802814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67656c3c471246c0a78d649cec0f5794)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:21.804896 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:21.855849 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67656c3c471246c0a78d649cec0f5794', 'request_id': 'req-4c54a321-b845-4719-b577-8bef0895507e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.862630 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67656c3c471246c0a78d649cec0f5794', 'request_id': 'req-4c54a321-b845-4719-b577-8bef0895507e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.870352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67656c3c471246c0a78d649cec0f5794', 'request_id': 'req-4c54a321-b845-4719-b577-8bef0895507e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.880680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] The token cache is being invalidate because project 67656c3c471246c0a78d649cec0f5794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:28:21.880972 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.881604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c54a321-b845-4719-b577-8bef0895507e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:21.886848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1373/2762] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:28:21 2022] DELETE /identity/v3/projects/67656c3c471246c0a78d649cec0f5794 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:21.888561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:21.888877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:21.889217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:21.906841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:21.908023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:21.967671 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1390/2763] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:22.029795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d570-7522-461e-86f1-db9169713047 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.030156 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d570-7522-461e-86f1-db9169713047 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.030543 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d570-7522-461e-86f1-db9169713047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.054765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c372d570-7522-461e-86f1-db9169713047 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:22.055995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c372d570-7522-461e-86f1-db9169713047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:22.065483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1374/2764] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:22.069927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.080142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9288a-03f3-4a32-9b80-3325356de264 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.085752 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.086448 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.086731 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.087007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.087762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:28:22.088139 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.089809 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.102051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1391/2765] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:28:22.106425 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d570-7522-461e-86f1-db9169713047 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.116086 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d570-7522-461e-86f1-db9169713047 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.122719 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.123383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.123672 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.123978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.124707 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.126639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.153939 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1375/2766] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:28:22 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:28:22.158424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.168542 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d911a9-52c7-4f49-97ba-34b96444c798 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.223924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.224630 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.224914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.225195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.225887 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.227886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.249269 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1392/2767] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:28:22 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:28:22.253439 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.264298 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0434-7cb5-4555-8b9a-414aaafb9dd8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.268929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.269579 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.269871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.270163 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.270902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.272518 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.282918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1376/2768] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:28:22.286814 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.297115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d34d-03bb-44fd-90c4-86cc2a5f01ba admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.302132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2526f8-e461-43d0-b8a4-57dba917082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.302793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2526f8-e461-43d0-b8a4-57dba917082e admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.303055 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2526f8-e461-43d0-b8a4-57dba917082e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.303337 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2526f8-e461-43d0-b8a4-57dba917082e admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.304065 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2526f8-e461-43d0-b8a4-57dba917082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.305727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2526f8-e461-43d0-b8a4-57dba917082e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.317643 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1393/2769] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:28:22.321856 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.332548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd9a2b-57d8-4abd-812c-b874034bdd02 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.338114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.339024 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.339348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.339634 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] PATH_INFO: `/v3/projects/aea4d57873e54073b3157654d4494059/users/6f52366191ee42d2a82981c2d1bc3dac/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.355273 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea4d57873e54073b3157654d4494059, user_id=6f52366191ee42d2a82981c2d1bc3dac, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.358162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.370832 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1377/2770] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:28:22 2022] PUT /identity/v3/projects/aea4d57873e54073b3157654d4494059/users/6f52366191ee42d2a82981c2d1bc3dac/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:22.381265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.381558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.381820 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.407828 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:22.411342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] MFA Rules not processed for user `6f52366191ee42d2a82981c2d1bc3dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:22.413386 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:22.493923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1394/2771] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:22.502868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:22.505008 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:22.569968 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e02b-817c-4171-8cdf-5e0bdde7b266 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:22.574191 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb003c3b-8ff6-46b9-a725-716b7604efac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:22.574863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb003c3b-8ff6-46b9-a725-716b7604efac service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:22.575147 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb003c3b-8ff6-46b9-a725-716b7604efac service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:22.575424 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb003c3b-8ff6-46b9-a725-716b7604efac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:22.584894 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb003c3b-8ff6-46b9-a725-716b7604efac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:22.586416 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb003c3b-8ff6-46b9-a725-716b7604efac service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:22.590228 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:22.597455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1378/2772] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:29.864893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:29.935649 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a420-88c9-4e67-9f7d-646e5e731d59 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:29.940842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:29.941735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:29.942016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:29.942292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] PATH_INFO: `/v3/users/6f52366191ee42d2a82981c2d1bc3dac` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:29.943561 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f52366191ee42d2a82981c2d1bc3dac)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:29.945568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:29.998693 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f52366191ee42d2a82981c2d1bc3dac'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.005523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f52366191ee42d2a82981c2d1bc3dac'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.018251 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f52366191ee42d2a82981c2d1bc3dac'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.019002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f52366191ee42d2a82981c2d1bc3dac'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.027998 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f52366191ee42d2a82981c2d1bc3dac'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.034132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1395/2773] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:28:29 2022] DELETE /identity/v3/users/6f52366191ee42d2a82981c2d1bc3dac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:30.038912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:30.039411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:30.039523 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:30.057336 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:28:30.058488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:30.119129 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1379/2774] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:28:30.129199 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:30.130856 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:30.159692 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:30.193303 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562a92e-728c-4403-a59a-276b907034a5 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:30.199282 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:30.200258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:30.200685 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:30.201079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:30.216524 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:30.218792 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:30.228778 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1396/2775] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:28:30.501103 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:28:30.502776 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:28:30.516504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adfe4f-5d82-4120-94cd-4a135fca43a8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:28:30.522257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:28:30.523151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:28:30.523438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:28:30.523717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] PATH_INFO: `/v3/projects/aea4d57873e54073b3157654d4494059` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:28:30.525084 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea4d57873e54073b3157654d4494059)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:28:30.526924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:28:30.578279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea4d57873e54073b3157654d4494059', 'request_id': 'req-20400130-7f2f-4431-9e12-21b01f88df21'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.584581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea4d57873e54073b3157654d4494059', 'request_id': 'req-20400130-7f2f-4431-9e12-21b01f88df21'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.593172 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea4d57873e54073b3157654d4494059', 'request_id': 'req-20400130-7f2f-4431-9e12-21b01f88df21'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.603343 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] The token cache is being invalidate because project aea4d57873e54073b3157654d4494059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:28:30.603633 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.604255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:28:30.605837 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1380/2776] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:28:30 2022] DELETE /identity/v3/projects/aea4d57873e54073b3157654d4494059 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:28:40.224317 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=16 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:40.600694 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:07.559729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:07.561183 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:07.622434 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:07.624855 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:07.643767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bc72a-8598-4cf8-ae55-613ab2a376d1 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:07.694783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400130-7f2f-4431-9e12-21b01f88df21 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:07.699618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:07.700519 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:07.700840 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:07.701122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] PATH_INFO: `/v3/users/b4780bb497234a249b6d23afdab14370` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:07.702453 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4780bb497234a249b6d23afdab14370)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:07.704447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:07.705972 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:07.706862 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:07.707145 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:07.707421 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:07.709228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:07.720980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:07.722746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:07.735052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1397/2777] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:07.757798 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4780bb497234a249b6d23afdab14370'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:07.758614 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4780bb497234a249b6d23afdab14370'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:07.772635 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4780bb497234a249b6d23afdab14370'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:07.782119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4780bb497234a249b6d23afdab14370'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:07.782937 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-29284c1b-5c26-4e8b-97ea-77833fd510a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4780bb497234a249b6d23afdab14370'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:07.796576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1381/2778] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:07 2022] DELETE /identity/v3/users/b4780bb497234a249b6d23afdab14370 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:07.973301 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:07.984810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07ba5-e1b5-4d07-b969-67e9ca6dd235 service placement] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.042553 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.043507 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.043789 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.044177 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] PATH_INFO: `/v3/projects/43c5da8fa182486990154b6f22539593` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.045374 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c5da8fa182486990154b6f22539593)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.047474 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.085573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:08.096135 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c5da8fa182486990154b6f22539593', 'request_id': 'req-002205ad-4b20-45e0-b160-7fd5a9fccb39'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:08.103902 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c5da8fa182486990154b6f22539593', 'request_id': 'req-002205ad-4b20-45e0-b160-7fd5a9fccb39'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:08.110167 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c5da8fa182486990154b6f22539593', 'request_id': 'req-002205ad-4b20-45e0-b160-7fd5a9fccb39'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:08.120349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] The token cache is being invalidate because project 43c5da8fa182486990154b6f22539593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:08.120674 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:08.121297 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-002205ad-4b20-45e0-b160-7fd5a9fccb39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:08.122865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1398/2779] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:07 2022] DELETE /identity/v3/projects/43c5da8fa182486990154b6f22539593 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:08.128359 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.128762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.129049 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.148388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:08.149677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:08.221722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1382/2780] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:08.230691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.230994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.231379 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.252406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:08.253678 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:08.262615 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1399/2781] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:08.267057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.278452 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7b41b-4008-45e2-9cd4-c86de8fd743d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.284625 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.285300 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.285585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.285868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.286596 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:29:08.286910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.288539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.300666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1383/2782] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:29:08.305041 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.314459 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb606f-4e5e-423b-a0b6-8a4e8c99c73d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.319656 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.320315 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.320644 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.320913 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.321598 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.323556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.351220 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1400/2783] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:29:08.355618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.366477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2eb3-a91d-496b-9654-ab7ac54630a7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.370327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:08.427030 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.427717 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.427997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.428282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.429009 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.430955 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.455230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1384/2784] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:08.459439 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.470767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e456aae-e6f9-4d52-a71c-843b6998bd68 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.479247 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.479885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.480188 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.480465 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.481249 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.483669 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.498147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1401/2785] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:08.502638 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.516542 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f09bc-57dd-41fc-8846-cfa95cc072c6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.526411 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac270571-9de9-4166-b05b-be5c9a176e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.527096 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac270571-9de9-4166-b05b-be5c9a176e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.527391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac270571-9de9-4166-b05b-be5c9a176e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.527673 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac270571-9de9-4166-b05b-be5c9a176e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.528409 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac270571-9de9-4166-b05b-be5c9a176e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.530167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac270571-9de9-4166-b05b-be5c9a176e0a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.541499 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1385/2786] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:08.546001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.556460 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb186e4-cf1b-4e95-ad23-758f5afd2869 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.561466 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.562360 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.562648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.562925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] PATH_INFO: `/v3/projects/7c12a528808a4f93a1c147b1c15489fd/users/b72ea5a8178d4bd1b89af0a365c3570c/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.578859 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c12a528808a4f93a1c147b1c15489fd, user_id=b72ea5a8178d4bd1b89af0a365c3570c, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.581605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.596762 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1402/2787] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:08 2022] PUT /identity/v3/projects/7c12a528808a4f93a1c147b1c15489fd/users/b72ea5a8178d4bd1b89af0a365c3570c/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:08.607985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.608284 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.608559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.637195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] MFA Rules not processed for user `b72ea5a8178d4bd1b89af0a365c3570c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:08.638427 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:08.702362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1386/2788] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:08.707075 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.771039 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e125-953b-42a5-998b-9fbe11e5e5a9 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.775578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.776239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.776522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.776829 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.777505 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.779424 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.806601 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1403/2789] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:08.811480 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.827857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630c457-8316-403f-a9bf-2d86f46c3c9b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.894235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.894923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.895207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.895482 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.896176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.898155 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.920101 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1387/2790] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:08 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:29:08.924407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.935627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242791-f45d-463f-9020-7c6f865e15e8 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.941329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.942007 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.942291 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.942568 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:08.943410 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:08.945083 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:08.955926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1404/2791] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:08.960642 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:08.970539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:08.976167 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25c0f-cb14-476d-afdb-4a6fd49a347f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:08.983637 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:08.984539 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:08.984886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:08.985255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] PATH_INFO: `/v3/projects/79e70dd17c864147845e59f93816ed41/users/01096f50c91244f7ac45b319ffd6fd67/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:09.000775 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e70dd17c864147845e59f93816ed41, user_id=01096f50c91244f7ac45b319ffd6fd67, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:09.003495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:09.018196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1388/2792] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:08 2022] PUT /identity/v3/projects/79e70dd17c864147845e59f93816ed41/users/01096f50c91244f7ac45b319ffd6fd67/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:09.022238 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:09.032434 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0b1b5-c4ab-43ba-8c0e-b585d3b28f84 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:09.061858 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:09.089995 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fb38-95e0-4077-8766-d04953cbfb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:09.090705 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fb38-95e0-4077-8766-d04953cbfb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:09.090994 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fb38-95e0-4077-8766-d04953cbfb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:09.091276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fb38-95e0-4077-8766-d04953cbfb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:09.092004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fb38-95e0-4077-8766-d04953cbfb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:09.093725 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fb38-95e0-4077-8766-d04953cbfb6a admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:09.103813 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1405/2793] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:09.108136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:09.118544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db1131-1e77-4563-bf37-bd5a548daa06 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:09.124073 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:09.125047 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:09.125328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:09.125664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] PATH_INFO: `/v3/projects/79e70dd17c864147845e59f93816ed41/users/01096f50c91244f7ac45b319ffd6fd67/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:09.127940 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e70dd17c864147845e59f93816ed41, user_id=01096f50c91244f7ac45b319ffd6fd67, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:09.130639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:09.141695 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1389/2794] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:09 2022] PUT /identity/v3/projects/79e70dd17c864147845e59f93816ed41/users/01096f50c91244f7ac45b319ffd6fd67/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:09.151842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448399-293f-4077-8a95-63076e2eca4c None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:09.152141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448399-293f-4077-8a95-63076e2eca4c None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:09.152422 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448399-293f-4077-8a95-63076e2eca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:09.180277 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-45448399-293f-4077-8a95-63076e2eca4c None None] MFA Rules not processed for user `01096f50c91244f7ac45b319ffd6fd67`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:09.181529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-45448399-293f-4077-8a95-63076e2eca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:09.260620 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1406/2795] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:29:09.277196 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:09.280179 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:09.340133 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde0f0-4a66-448c-8660-92eb22698d29 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:09.344297 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:09.344978 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:09.345260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:09.345534 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:09.356077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:09.357561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:09.367462 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1390/2796] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:09.451190 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448399-293f-4077-8a95-63076e2eca4c None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:09.462664 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448399-293f-4077-8a95-63076e2eca4c None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:09.467327 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567cce3-9675-48b9-8179-8fdc8c6763ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:09.467980 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567cce3-9675-48b9-8179-8fdc8c6763ac service cinder] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:09.468265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567cce3-9675-48b9-8179-8fdc8c6763ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:09.468539 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567cce3-9675-48b9-8179-8fdc8c6763ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:09.533445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567cce3-9675-48b9-8179-8fdc8c6763ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:09.534931 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567cce3-9675-48b9-8179-8fdc8c6763ac service cinder] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:09.543900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1407/2797] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:17.583995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:17.650521 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24378c7b-0ca8-40ce-b41b-99580cd1fe9f service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:17.655561 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:17.656447 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:17.656763 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:17.657041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] PATH_INFO: `/v3/users/b72ea5a8178d4bd1b89af0a365c3570c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:17.658317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72ea5a8178d4bd1b89af0a365c3570c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:17.660641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:17.719081 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72ea5a8178d4bd1b89af0a365c3570c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:17.719733 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72ea5a8178d4bd1b89af0a365c3570c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:17.734686 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72ea5a8178d4bd1b89af0a365c3570c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:17.743327 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72ea5a8178d4bd1b89af0a365c3570c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:17.743944 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72ea5a8178d4bd1b89af0a365c3570c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:17.745830 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:17.758619 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1391/2798] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:17 2022] DELETE /identity/v3/users/b72ea5a8178d4bd1b89af0a365c3570c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:17.764057 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:17.764518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:17.764787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:17.783375 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:17.784627 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:17.840371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=100 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:17.853364 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1408/2799] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:17.863547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:17.865255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:17.926870 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2f38-13d0-4850-a4ca-0e75fe7e27ac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:17.931546 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:17.932326 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:17.932648 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:17.932932 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:17.942871 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:17.944329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:17.954701 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1392/2800] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:18.219746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:18.221295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:18.235960 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcaeb2-a8a3-4e78-8ed9-9fcd0c352eb7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:18.242318 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:18.243378 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:18.243640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:18.243933 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] PATH_INFO: `/v3/projects/7c12a528808a4f93a1c147b1c15489fd` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:18.245281 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c12a528808a4f93a1c147b1c15489fd)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:18.247300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:18.298484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c12a528808a4f93a1c147b1c15489fd', 'request_id': 'req-714bf4c9-4bd8-48e9-a053-c948a2b73f30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.307404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c12a528808a4f93a1c147b1c15489fd', 'request_id': 'req-714bf4c9-4bd8-48e9-a053-c948a2b73f30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.313783 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c12a528808a4f93a1c147b1c15489fd', 'request_id': 'req-714bf4c9-4bd8-48e9-a053-c948a2b73f30'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.324166 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] The token cache is being invalidate because project 7c12a528808a4f93a1c147b1c15489fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:18.324471 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.325116 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.326665 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1409/2801] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:18 2022] DELETE /identity/v3/projects/7c12a528808a4f93a1c147b1c15489fd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:18.330727 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:18.340569 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018c4e-a17d-4469-9e52-0637d9af53ae service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:18.399375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:18.400219 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:18.400540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:18.400845 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] PATH_INFO: `/v3/users/01096f50c91244f7ac45b319ffd6fd67` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:18.402078 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01096f50c91244f7ac45b319ffd6fd67)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:18.404058 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:18.452910 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01096f50c91244f7ac45b319ffd6fd67'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.453565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01096f50c91244f7ac45b319ffd6fd67'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.465551 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01096f50c91244f7ac45b319ffd6fd67'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.474646 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01096f50c91244f7ac45b319ffd6fd67'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.475351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e1590af0-8609-4b45-81cc-c6aa708f0737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01096f50c91244f7ac45b319ffd6fd67'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.487960 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1393/2802] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:18 2022] DELETE /identity/v3/users/01096f50c91244f7ac45b319ffd6fd67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:18.762443 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:18.763924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:18.777438 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf4c9-4bd8-48e9-a053-c948a2b73f30 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:18.848577 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:18.849495 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:18.849781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:18.850059 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] PATH_INFO: `/v3/projects/79e70dd17c864147845e59f93816ed41` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:18.851349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e70dd17c864147845e59f93816ed41)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:18.853412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:18.905020 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e70dd17c864147845e59f93816ed41', 'request_id': 'req-32459a36-89e7-4bce-9324-fdedcc0ce5af'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.913312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e70dd17c864147845e59f93816ed41', 'request_id': 'req-32459a36-89e7-4bce-9324-fdedcc0ce5af'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.920102 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e70dd17c864147845e59f93816ed41', 'request_id': 'req-32459a36-89e7-4bce-9324-fdedcc0ce5af'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.930348 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] The token cache is being invalidate because project 79e70dd17c864147845e59f93816ed41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:18.930635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.931294 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-32459a36-89e7-4bce-9324-fdedcc0ce5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:18.932905 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1410/2803] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:18 2022] DELETE /identity/v3/projects/79e70dd17c864147845e59f93816ed41 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:18.937893 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:18.938391 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:18.938503 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:18.959026 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:18.960215 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:18.965666 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:19.021514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1394/2804] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:19.029546 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.029866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.030144 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.043617 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:19.050885 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:19.052698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:19.061791 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1411/2805] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:19.065995 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.075781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c092b-8eb7-459c-9f0d-b2343bdc0837 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.081241 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.081907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.082189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.082461 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.083190 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:29:19.083496 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.085183 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.097826 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1395/2806] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:29:19.102061 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.111759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c9ab-5ebd-4617-a461-e0786a356a1b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.117278 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.117938 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.118229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.118512 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.119204 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.121210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.148798 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1412/2807] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:19.153044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.162973 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b5af9-f15d-4f95-9017-0f200e8f3587 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.218260 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.218927 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.219211 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.219488 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.220178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.222150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.243176 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1396/2808] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:19.247549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.258232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2c8b1-5725-4937-9e61-693bb3062ca2 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.264004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.264746 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.265034 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.265310 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.266048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.267689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.279907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1413/2809] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:19.283912 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.294137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9000-f69f-438e-bc01-421ac7a274ff admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.299118 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e8d7b-f57b-4595-a740-d461c321372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.299779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e8d7b-f57b-4595-a740-d461c321372b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.300069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e8d7b-f57b-4595-a740-d461c321372b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.300351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e8d7b-f57b-4595-a740-d461c321372b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.301126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e8d7b-f57b-4595-a740-d461c321372b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.302886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e8d7b-f57b-4595-a740-d461c321372b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.312886 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1397/2810] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:19.316979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.327182 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907ab90-0a78-449e-882b-344040a30906 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.332321 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.333253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.333531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.333892 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] PATH_INFO: `/v3/projects/aa6d284b7df54961ad2a1db389dcbe20/users/13800e160c314082b2b01bcbbc43ba1c/roles/c1a812e032604c4683295a602c263e78` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.348554 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6d284b7df54961ad2a1db389dcbe20, user_id=13800e160c314082b2b01bcbbc43ba1c, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.351328 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.365535 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1414/2811] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:19 2022] PUT /identity/v3/projects/aa6d284b7df54961ad2a1db389dcbe20/users/13800e160c314082b2b01bcbbc43ba1c/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:29:19.377012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175519-de55-42db-8f7a-892504442164 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.377303 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175519-de55-42db-8f7a-892504442164 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.377585 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175519-de55-42db-8f7a-892504442164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.406230 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-24175519-de55-42db-8f7a-892504442164 None None] MFA Rules not processed for user `13800e160c314082b2b01bcbbc43ba1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:19.407505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-24175519-de55-42db-8f7a-892504442164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:19.473061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1398/2812] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:19.477751 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.543914 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b676985-de57-43af-9b64-d975a9c8cb94 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.549736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.550419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.551265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.551265 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.551738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.553988 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.580822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1415/2813] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:29:19.585061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175519-de55-42db-8f7a-892504442164 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.595714 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175519-de55-42db-8f7a-892504442164 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.599611 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:19.657540 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.658233 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.658525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.658803 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.659599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.661604 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.684335 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1399/2814] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:19.686870 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.697908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e529-4819-4a45-aab1-d65ac71a0206 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.703846 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.704522 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.704841 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.705115 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.705852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.707484 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.718571 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1416/2815] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:19.723064 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.733848 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11b221-5711-4609-aafd-0dc62a3c2f6c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.739405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.740373 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.740652 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.740957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] PATH_INFO: `/v3/projects/eac42bb1005a4b469f6e500add7aad28/users/8dc2ff9f6bc14947be83efde6b43bf70/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.757141 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac42bb1005a4b469f6e500add7aad28, user_id=8dc2ff9f6bc14947be83efde6b43bf70, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.759844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.774559 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1400/2816] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:19 2022] PUT /identity/v3/projects/eac42bb1005a4b469f6e500add7aad28/users/8dc2ff9f6bc14947be83efde6b43bf70/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:19.778767 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.789202 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedda2e3-6e12-4d33-bde8-b6a4167476da admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.847730 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d271-e19b-406b-9d3d-2fe2b4edd1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.848407 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d271-e19b-406b-9d3d-2fe2b4edd1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.848727 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d271-e19b-406b-9d3d-2fe2b4edd1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.849011 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d271-e19b-406b-9d3d-2fe2b4edd1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.849838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0d271-e19b-406b-9d3d-2fe2b4edd1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.851476 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0d271-e19b-406b-9d3d-2fe2b4edd1a6 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.861488 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1417/2817] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:19.866050 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:19.876547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84495-c87d-4f37-a9cf-75c1ff883b34 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:19.882282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:19.883192 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.883463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.883737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] PATH_INFO: `/v3/projects/eac42bb1005a4b469f6e500add7aad28/users/8dc2ff9f6bc14947be83efde6b43bf70/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.886018 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac42bb1005a4b469f6e500add7aad28, user_id=8dc2ff9f6bc14947be83efde6b43bf70, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:19.889090 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:19.900186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1401/2818] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:19 2022] PUT /identity/v3/projects/eac42bb1005a4b469f6e500add7aad28/users/8dc2ff9f6bc14947be83efde6b43bf70/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:29:19.910329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:19.910621 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:19.910907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:19.936056 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:19.939525 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] MFA Rules not processed for user `8dc2ff9f6bc14947be83efde6b43bf70`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:19.941359 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:20.012272 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1418/2819] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:29:20.024178 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:20.026240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:20.083698 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2246-8244-45f2-ad7e-2c89123eacb6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:20.087839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7a9d6-d2f0-4b3a-821f-afb694df8f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:20.088487 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7a9d6-d2f0-4b3a-821f-afb694df8f5a service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:20.088810 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7a9d6-d2f0-4b3a-821f-afb694df8f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:20.089088 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7a9d6-d2f0-4b3a-821f-afb694df8f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:20.098620 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7a9d6-d2f0-4b3a-821f-afb694df8f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:20.100135 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7a9d6-d2f0-4b3a-821f-afb694df8f5a service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:20.109636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1402/2820] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:20.249738 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:20.314908 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd2e37-34b7-4099-a2cf-5f031c27b7d3 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:20.321109 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:20.322001 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:20.322280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:20.322552 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] PATH_INFO: `/v3/users/13800e160c314082b2b01bcbbc43ba1c` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:20.323886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13800e160c314082b2b01bcbbc43ba1c)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:20.325929 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:20.390499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13800e160c314082b2b01bcbbc43ba1c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.397893 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13800e160c314082b2b01bcbbc43ba1c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.410635 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13800e160c314082b2b01bcbbc43ba1c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.411363 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13800e160c314082b2b01bcbbc43ba1c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.421236 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13800e160c314082b2b01bcbbc43ba1c'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.428572 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1419/2821] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:20 2022] DELETE /identity/v3/users/13800e160c314082b2b01bcbbc43ba1c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:20.434279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:20.434720 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:20.435137 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:20.457591 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:20.459077 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:20.520039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1403/2822] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:29:20.529950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:20.531405 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:20.553153 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:20.592852 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcec31-3b4e-48f7-a7ee-5f894db3508b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:20.597048 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:20.597716 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:20.597999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:20.598280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:20.607641 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:20.609192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:20.618691 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1420/2823] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:20.906971 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:20.908483 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:20.916270 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:20.921715 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb735775-2f61-41a9-8a9b-7175b43bf7e8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:20.927217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:20.928217 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:20.928528 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:20.928867 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] PATH_INFO: `/v3/projects/aa6d284b7df54961ad2a1db389dcbe20` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:20.930257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6d284b7df54961ad2a1db389dcbe20)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:20.932208 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:20.979761 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6d284b7df54961ad2a1db389dcbe20', 'request_id': 'req-7a40544f-3aeb-4f2d-978e-4b7c566fe296'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.986308 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6d284b7df54961ad2a1db389dcbe20', 'request_id': 'req-7a40544f-3aeb-4f2d-978e-4b7c566fe296'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:20.995758 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6d284b7df54961ad2a1db389dcbe20', 'request_id': 'req-7a40544f-3aeb-4f2d-978e-4b7c566fe296'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.007352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] The token cache is being invalidate because project aa6d284b7df54961ad2a1db389dcbe20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:21.007643 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.008279 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.009872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1404/2824] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:20 2022] DELETE /identity/v3/projects/aa6d284b7df54961ad2a1db389dcbe20 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:21.014280 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:21.024103 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035474d-f43a-48da-9f6f-e43770a10ac2 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:21.083729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:21.084638 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.084909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.085192 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] PATH_INFO: `/v3/users/8dc2ff9f6bc14947be83efde6b43bf70` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.086518 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc2ff9f6bc14947be83efde6b43bf70)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:21.088515 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:21.137256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc2ff9f6bc14947be83efde6b43bf70'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.143954 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc2ff9f6bc14947be83efde6b43bf70'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.155491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc2ff9f6bc14947be83efde6b43bf70'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.156147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc2ff9f6bc14947be83efde6b43bf70'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.164440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-2c968927-955c-475e-9e3b-dd543479fd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc2ff9f6bc14947be83efde6b43bf70'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.171081 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1421/2825] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:21 2022] DELETE /identity/v3/users/8dc2ff9f6bc14947be83efde6b43bf70 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:21.450266 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:21.451805 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:21.467197 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40544f-3aeb-4f2d-978e-4b7c566fe296 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:21.529274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:21.530066 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.530358 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.530636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] PATH_INFO: `/v3/projects/eac42bb1005a4b469f6e500add7aad28` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.531863 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac42bb1005a4b469f6e500add7aad28)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:21.533869 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:21.591481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac42bb1005a4b469f6e500add7aad28', 'request_id': 'req-6f782935-9992-4766-91f3-c2039a73cea7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.599348 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac42bb1005a4b469f6e500add7aad28', 'request_id': 'req-6f782935-9992-4766-91f3-c2039a73cea7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.613430 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac42bb1005a4b469f6e500add7aad28', 'request_id': 'req-6f782935-9992-4766-91f3-c2039a73cea7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.624827 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] The token cache is being invalidate because project eac42bb1005a4b469f6e500add7aad28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:21.625115 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.625765 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6f782935-9992-4766-91f3-c2039a73cea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:21.627377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1405/2826] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:21 2022] DELETE /identity/v3/projects/eac42bb1005a4b469f6e500add7aad28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:21.633970 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.634263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.634574 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.657253 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:21.658458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:21.693271 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:21.724610 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1422/2827] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:21.733240 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.733535 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.733813 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.755795 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:21.757165 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:21.767017 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1406/2828] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:21.772165 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:21.788501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3f57-5044-4aa3-8c9d-903b938b998b None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:21.794392 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:21.795071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.795345 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.795640 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.796362 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:29:21.796729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:21.798578 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:21.812670 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1423/2829] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:29:21.818347 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:21.829173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6f7e-fbe2-4891-8982-377b77240f7b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:21.835773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:21.836443 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.836768 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.837040 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.837789 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:21.839791 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:21.844690 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:21.873281 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1407/2830] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:21 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:29:21.875087 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:21.885973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66b79-d11c-4a36-884c-9807e68dd5f4 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:21.955148 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:21.955886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:21.956196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:21.956478 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:21.957453 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:21.959425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:21.980715 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1424/2831] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:21 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:29:21.984974 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:21.995500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c2ee-69d9-49c4-a449-344065dc8792 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:22.002657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:22.003774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:22.004255 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:22.004782 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:22.005929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:22.007558 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:22.018357 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1408/2832] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:29:22.023417 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:22.034526 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ac128-42b6-4734-8a83-8bb64b835086 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:22.040098 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b98a-96c6-4f01-a610-c0dbb3f2d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:22.040728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b98a-96c6-4f01-a610-c0dbb3f2d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:22.041014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b98a-96c6-4f01-a610-c0dbb3f2d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:22.041295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b98a-96c6-4f01-a610-c0dbb3f2d0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:22.042031 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b98a-96c6-4f01-a610-c0dbb3f2d0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:22.043697 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b98a-96c6-4f01-a610-c0dbb3f2d0a1 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:22.058217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1425/2833] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:22.063505 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:22.076491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4928f8b-32c2-49eb-886e-460a4cc616d7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:22.083152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:22.084111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:22.084395 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:22.084741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] PATH_INFO: `/v3/projects/f56ffd268f3444d586dff584417286b3/users/70d1eecc274348799680acfc5e1e6bec/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:22.101383 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56ffd268f3444d586dff584417286b3, user_id=70d1eecc274348799680acfc5e1e6bec, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:22.104410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:22.124492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1409/2834] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:22 2022] PUT /identity/v3/projects/f56ffd268f3444d586dff584417286b3/users/70d1eecc274348799680acfc5e1e6bec/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:29:22.137915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:22.138210 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:22.138521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:22.166737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] MFA Rules not processed for user `70d1eecc274348799680acfc5e1e6bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:22.167968 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:22.243759 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1426/2835] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:22.256994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:22.259074 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:22.329745 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230b318-a389-4da1-afe8-f52e129dd2b4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:22.335465 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3014-7822-4278-8fdb-ec77ec3971d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:22.336239 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3014-7822-4278-8fdb-ec77ec3971d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:22.336586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3014-7822-4278-8fdb-ec77ec3971d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:22.336961 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3014-7822-4278-8fdb-ec77ec3971d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:22.347225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3014-7822-4278-8fdb-ec77ec3971d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:22.348762 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3014-7822-4278-8fdb-ec77ec3971d8 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:22.358150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1410/2836] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:32.240372 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:32.353902 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:40.058508 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:40.126924 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd624a-ebe1-458b-9600-14b3e5b77686 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:40.131916 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:40.132837 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.133118 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.133404 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] PATH_INFO: `/v3/users/70d1eecc274348799680acfc5e1e6bec` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.134650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d1eecc274348799680acfc5e1e6bec)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:40.137032 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:40.188757 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d1eecc274348799680acfc5e1e6bec'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.195523 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d1eecc274348799680acfc5e1e6bec'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.207258 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d1eecc274348799680acfc5e1e6bec'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.207946 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d1eecc274348799680acfc5e1e6bec'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.217788 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d1eecc274348799680acfc5e1e6bec'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.223677 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1427/2837] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:40 2022] DELETE /identity/v3/users/70d1eecc274348799680acfc5e1e6bec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:40.230872 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.231388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.231497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.250923 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:40.252264 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:40.316455 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1411/2838] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 17:29:40.326300 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:40.327999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:40.387309 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525b8e-978c-4b68-9f4d-06164bac6441 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:40.391449 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573013d-bc51-4294-8f7e-f921a662924c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:40.392138 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573013d-bc51-4294-8f7e-f921a662924c service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.392425 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573013d-bc51-4294-8f7e-f921a662924c service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.392864 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573013d-bc51-4294-8f7e-f921a662924c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.402875 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573013d-bc51-4294-8f7e-f921a662924c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:40.404330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573013d-bc51-4294-8f7e-f921a662924c service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:40.414195 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1428/2839] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:40.682092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:40.683735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:40.696677 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32617f-14b7-4d80-aac3-7e409c86fde6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:40.703098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:40.703987 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.704463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.704774 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] PATH_INFO: `/v3/projects/f56ffd268f3444d586dff584417286b3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.706098 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56ffd268f3444d586dff584417286b3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:40.708051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:40.757377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56ffd268f3444d586dff584417286b3', 'request_id': 'req-898528c1-7f64-47b4-a900-cd07f1e482ab'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.763641 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56ffd268f3444d586dff584417286b3', 'request_id': 'req-898528c1-7f64-47b4-a900-cd07f1e482ab'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.774329 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56ffd268f3444d586dff584417286b3', 'request_id': 'req-898528c1-7f64-47b4-a900-cd07f1e482ab'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.784982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] The token cache is being invalidate because project f56ffd268f3444d586dff584417286b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:40.785272 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.785924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-898528c1-7f64-47b4-a900-cd07f1e482ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:40.787525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1412/2840] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:40 2022] DELETE /identity/v3/projects/f56ffd268f3444d586dff584417286b3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:40.792491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.792850 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.793108 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.814132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:40.815353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:40.832263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:40.878211 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1429/2841] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:40.886438 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.886741 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.887023 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.906044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:40.907231 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:40.915015 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1413/2842] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:40.919178 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:40.929411 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b168d-4e51-4816-89e4-5b07daf16939 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:40.934387 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:40.935076 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.935365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.935645 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.936383 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:29:40.936747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:40.938437 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:40.951545 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1430/2843] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:29:40.956054 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:40.965691 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd54ffc-1e09-4663-aa74-a9ace2222ae7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:40.972842 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:40.973510 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:40.973793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:40.974057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:40.974748 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:40.976788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:41.006410 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1414/2844] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:40 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:41.010816 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:41.021650 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6c4c1-2ac1-44c1-84b0-8dd461359009 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:41.079380 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:41.080052 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:41.080313 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:41.080634 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:41.081329 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:41.083295 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:41.104381 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1431/2845] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:41.108547 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:41.119131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc132f-3502-4651-b483-b5c02cf3a9bb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:41.124140 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:41.124843 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:41.125136 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:41.125440 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:41.126162 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:41.127858 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:41.138844 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1415/2846] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:41.142646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:41.153786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4992cb-33f9-43aa-9f3c-7da928960970 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:41.159054 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dfd71-818b-4a80-a0ca-45173c67f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:41.159728 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dfd71-818b-4a80-a0ca-45173c67f2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:41.160014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dfd71-818b-4a80-a0ca-45173c67f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:41.160292 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dfd71-818b-4a80-a0ca-45173c67f2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:41.161071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dfd71-818b-4a80-a0ca-45173c67f2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:41.162699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dfd71-818b-4a80-a0ca-45173c67f2ee admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:41.172927 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1432/2847] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:41.177508 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:41.187838 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f957-ac24-4f1d-ae2d-790eac4edb24 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:41.192584 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:41.193493 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:41.193797 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:41.194069 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] PATH_INFO: `/v3/projects/add0b85fcf364b70b22eae90991dd841/users/18722e745fff4f3aa4365596e34a4615/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:41.208742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add0b85fcf364b70b22eae90991dd841, user_id=18722e745fff4f3aa4365596e34a4615, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:41.211458 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:41.226186 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1416/2848] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:41 2022] PUT /identity/v3/projects/add0b85fcf364b70b22eae90991dd841/users/18722e745fff4f3aa4365596e34a4615/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:41.237661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:41.237979 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:41.238244 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:41.266288 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] MFA Rules not processed for user `18722e745fff4f3aa4365596e34a4615`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:41.267551 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:41.334833 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1433/2849] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:41.349173 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:41.351706 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:41.377151 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:41.421184 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75ca2-5359-42dc-ba2e-f2ff5599a000 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:41.425421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558beb9d-ab79-44bd-b85f-6b0b77483736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7460f33e2f74a1e86b76eab550b7c79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:41.426087 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558beb9d-ab79-44bd-b85f-6b0b77483736 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:41.426376 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558beb9d-ab79-44bd-b85f-6b0b77483736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:41.426655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558beb9d-ab79-44bd-b85f-6b0b77483736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:41.435414 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558beb9d-ab79-44bd-b85f-6b0b77483736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:41.436900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558beb9d-ab79-44bd-b85f-6b0b77483736 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:41.445847 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1417/2850] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:44.497647 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:44.518886 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:44.565915 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86da59-c24a-4122-b95d-fb7574cf87a7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:44.571229 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:44.572107 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:44.572388 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:44.572675 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] PATH_INFO: `/v3/users/18722e745fff4f3aa4365596e34a4615` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:44.573872 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18722e745fff4f3aa4365596e34a4615)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:44.575865 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:44.626341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18722e745fff4f3aa4365596e34a4615'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:44.633205 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18722e745fff4f3aa4365596e34a4615'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:44.646520 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18722e745fff4f3aa4365596e34a4615'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:44.647415 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18722e745fff4f3aa4365596e34a4615'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:44.658533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18722e745fff4f3aa4365596e34a4615'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:44.665030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1434/2851] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:29:44 2022] DELETE /identity/v3/users/18722e745fff4f3aa4365596e34a4615 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:44.669724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:44.670181 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:44.670375 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:44.690094 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:44.691328 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:44.755370 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1418/2852] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:44.767169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:44.768909 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:44.831137 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92d0b2-bbf2-448e-95be-5ece8aafb769 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:44.836344 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168094-a727-436e-9f52-ea24b590b304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:44.837035 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168094-a727-436e-9f52-ea24b590b304 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:44.837324 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168094-a727-436e-9f52-ea24b590b304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:44.837608 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168094-a727-436e-9f52-ea24b590b304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:44.847444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35168094-a727-436e-9f52-ea24b590b304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:44.848948 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35168094-a727-436e-9f52-ea24b590b304 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:44.858334 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1435/2853] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:45.134317 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.135839 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:45.149492 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01026c43-edef-463a-aac4-d17f70d9ab6d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.155548 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266787-911a-4318-b163-247014a90443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.156589 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266787-911a-4318-b163-247014a90443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.156922 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266787-911a-4318-b163-247014a90443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.157229 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266787-911a-4318-b163-247014a90443 admin admin] PATH_INFO: `/v3/projects/add0b85fcf364b70b22eae90991dd841` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.158408 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266787-911a-4318-b163-247014a90443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=add0b85fcf364b70b22eae90991dd841)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.160381 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266787-911a-4318-b163-247014a90443 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.212729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39266787-911a-4318-b163-247014a90443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add0b85fcf364b70b22eae90991dd841', 'request_id': 'req-39266787-911a-4318-b163-247014a90443'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:45.218924 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39266787-911a-4318-b163-247014a90443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add0b85fcf364b70b22eae90991dd841', 'request_id': 'req-39266787-911a-4318-b163-247014a90443'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:45.227248 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39266787-911a-4318-b163-247014a90443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add0b85fcf364b70b22eae90991dd841', 'request_id': 'req-39266787-911a-4318-b163-247014a90443'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:45.237495 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39266787-911a-4318-b163-247014a90443 admin admin] The token cache is being invalidate because project add0b85fcf364b70b22eae90991dd841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:29:45.237778 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39266787-911a-4318-b163-247014a90443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:45.238392 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-39266787-911a-4318-b163-247014a90443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:29:45.239931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1419/2854] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:29:45 2022] DELETE /identity/v3/projects/add0b85fcf364b70b22eae90991dd841 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:29:45.244900 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.245201 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.245486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.264412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:45.265676 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:45.303260 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:45.331884 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1436/2855] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:45.339905 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.340216 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.340477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.359929 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:45.361194 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:45.370530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1420/2856] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:45.375014 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.385074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334dc5d-613f-43b9-b10e-599cb1eb06c7 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.390907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.391570 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.391860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.392141 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.392976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:29:45.393389 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.395030 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.406920 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1437/2857] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:29:45.411446 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.420998 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea043b-1498-41c8-be5f-a1b95fb2e68d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.427385 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.428059 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.428347 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.428636 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.429345 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.431282 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.460003 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1421/2858] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:29:45 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:45.464149 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.474454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31c1b-f91c-4096-8773-bd1fc62bb897 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.532376 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.533066 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.533241 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.533548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.534285 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.536242 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.562445 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1438/2859] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:29:45 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:29:45.567793 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.578274 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3218b6-ba4d-4691-b83a-dc6dedf9c68e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.583169 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.583841 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.584126 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.584405 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.585161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.586781 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.597441 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1422/2860] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:29:45.601688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.611701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8d5a6-104c-4ed4-a400-67213e5e0f2b admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.616811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d22e66-3256-4d68-8248-7dbd6884cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.617487 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d22e66-3256-4d68-8248-7dbd6884cc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.617763 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d22e66-3256-4d68-8248-7dbd6884cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.618023 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d22e66-3256-4d68-8248-7dbd6884cc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.618748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d22e66-3256-4d68-8248-7dbd6884cc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.620353 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d22e66-3256-4d68-8248-7dbd6884cc9c admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.630497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1439/2861] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:29:45.634606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.645735 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba52854-4445-459c-b82f-4714ea1a9046 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.651057 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.651956 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.652235 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.652514 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] PATH_INFO: `/v3/projects/e3023eb470a74a0fabb03d6c728d2b9e/users/41acfe34138c48a8b82da6825aeb54f9/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.654834 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:45.669687 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3023eb470a74a0fabb03d6c728d2b9e, user_id=41acfe34138c48a8b82da6825aeb54f9, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.672401 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.687384 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1423/2862] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:29:45 2022] PUT /identity/v3/projects/e3023eb470a74a0fabb03d6c728d2b9e/users/41acfe34138c48a8b82da6825aeb54f9/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:29:45.698161 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.698454 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.698736 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.725939 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] MFA Rules not processed for user `41acfe34138c48a8b82da6825aeb54f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:29:45.727239 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:45.793009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1440/2863] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:29:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:29:45.808022 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:29:45.810785 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:29:45.872734 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351f2dc-3158-4a6c-aa2f-2d4f4e4386c1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:29:45.877207 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1942ff-054d-4104-86b5-ba8e678b7ae7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49486e8648f34ebf82979c60ab45ff6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:29:45.877900 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1942ff-054d-4104-86b5-ba8e678b7ae7 service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:29:45.878189 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1942ff-054d-4104-86b5-ba8e678b7ae7 service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:29:45.878470 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1942ff-054d-4104-86b5-ba8e678b7ae7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:29:45.888590 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1942ff-054d-4104-86b5-ba8e678b7ae7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:29:45.890100 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1942ff-054d-4104-86b5-ba8e678b7ae7 service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:29:45.900051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1424/2864] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:29:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:29:55.790227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:29:55.895423 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:17.313999 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:17.433907 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827262-fd49-4f63-ab84-031b2887ab54 None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:17.441702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:17.443058 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:17.443426 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:17.443790 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] PATH_INFO: `/v3/users/41acfe34138c48a8b82da6825aeb54f9` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:17.445793 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41acfe34138c48a8b82da6825aeb54f9)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:17.448855 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:17.503016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41acfe34138c48a8b82da6825aeb54f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:17.511440 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41acfe34138c48a8b82da6825aeb54f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:17.524222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41acfe34138c48a8b82da6825aeb54f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:17.525016 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41acfe34138c48a8b82da6825aeb54f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:17.533250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41acfe34138c48a8b82da6825aeb54f9'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:17.540169 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1441/2865] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:30:17 2022] DELETE /identity/v3/users/41acfe34138c48a8b82da6825aeb54f9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:30:17.545161 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:17.545747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:17.545747 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:17.595857 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:17.597131 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:17.668180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1425/2866] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:17.678009 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:17.679533 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:17.722531 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:17.777925 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c4f0-e581-463f-a279-741eaddc9929 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:17.782021 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7725a-8835-4135-a8c0-13746dda3b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:17.782683 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7725a-8835-4135-a8c0-13746dda3b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:17.782966 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7725a-8835-4135-a8c0-13746dda3b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:17.783330 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7725a-8835-4135-a8c0-13746dda3b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:17.793068 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7725a-8835-4135-a8c0-13746dda3b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:17.794496 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7725a-8835-4135-a8c0-13746dda3b39 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:17.804519 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1442/2867] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:30:18.069372 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.071007 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:18.084039 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae5fd-c48b-4dff-ba91-e7690b92aa82 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.089333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.090225 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.090500 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.090764 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] PATH_INFO: `/v3/projects/e3023eb470a74a0fabb03d6c728d2b9e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.092520 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3023eb470a74a0fabb03d6c728d2b9e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.094705 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.143657 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3023eb470a74a0fabb03d6c728d2b9e', 'request_id': 'req-e4c03a2c-d35b-4632-9a32-39dd1322053a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:18.149655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3023eb470a74a0fabb03d6c728d2b9e', 'request_id': 'req-e4c03a2c-d35b-4632-9a32-39dd1322053a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:18.158122 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3023eb470a74a0fabb03d6c728d2b9e', 'request_id': 'req-e4c03a2c-d35b-4632-9a32-39dd1322053a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:18.170702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] The token cache is being invalidate because project e3023eb470a74a0fabb03d6c728d2b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:30:18.170997 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:18.171663 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e4c03a2c-d35b-4632-9a32-39dd1322053a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:30:18.173269 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1426/2868] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:30:18 2022] DELETE /identity/v3/projects/e3023eb470a74a0fabb03d6c728d2b9e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:30:18.179044 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.179451 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.179873 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.231661 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:18.233051 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:18.300923 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1443/2869] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:18.363555 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.363773 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.364014 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.387407 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:18.389557 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:18.404509 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1427/2870] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:18.409106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.424883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dda9f-4ac7-45a3-a2cf-8c68113cd92d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.432548 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.433248 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.433529 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.433800 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] PATH_INFO: `/v3/domains` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.434556 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:30:18.434863 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.436547 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.448871 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1444/2871] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 17:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:30:18.453324 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.463027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba7c61-7d67-44a4-b82f-cc0f7ca6c307 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.469067 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.469725 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.470011 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.470292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.470985 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.472957 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.501787 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1428/2872] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:30:18 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:30:18.506147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.516883 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e0d11-5c59-48a1-ae19-00100e9b0248 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.580808 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.581501 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.581815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.582094 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.582774 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.584756 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.600976 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:18.609485 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1445/2873] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:30:18 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:30:18.611475 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.622565 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027982e-b587-4bae-89f1-79c7ffc984d0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.627915 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.628626 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.628925 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.629214 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.629994 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.631655 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.643330 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1429/2874] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:30:18.648147 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.664657 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e76f4-d4f1-45eb-900e-1c52c2bed989 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.672446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae20ae2-a822-412d-b5d9-15541370454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.673154 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20ae2-a822-412d-b5d9-15541370454b admin admin] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.673446 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20ae2-a822-412d-b5d9-15541370454b admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.673713 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20ae2-a822-412d-b5d9-15541370454b admin admin] PATH_INFO: `/v3/roles` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.674441 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae20ae2-a822-412d-b5d9-15541370454b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.676074 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae20ae2-a822-412d-b5d9-15541370454b admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.686826 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1446/2875] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:30:18.691061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.702692 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24863e48-0825-4fc3-8daa-7f3c3d2727ff admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.708517 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.709473 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.709769 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.710051 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] PATH_INFO: `/v3/projects/62a064d446ad4feea4888963e9db6511/users/fcbe18db4b734d26b1820f0c2928b571/roles/c1a812e032604c4683295a602c263e78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.726481 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a064d446ad4feea4888963e9db6511, user_id=fcbe18db4b734d26b1820f0c2928b571, role_id=c1a812e032604c4683295a602c263e78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.729256 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.731846 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:18.746606 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1430/2876] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:30:18 2022] PUT /identity/v3/projects/62a064d446ad4feea4888963e9db6511/users/fcbe18db4b734d26b1820f0c2928b571/roles/c1a812e032604c4683295a602c263e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:30:18.751699 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd415f-1747-458a-8098-10b69c81cfa6 None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.752002 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd415f-1747-458a-8098-10b69c81cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.752289 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd415f-1747-458a-8098-10b69c81cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.770472 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-8bbd415f-1747-458a-8098-10b69c81cfa6 None None] MFA Rules not processed for user `eef11ad96d374697895a79e0a7fd9e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:18.771688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-8bbd415f-1747-458a-8098-10b69c81cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:18.837604 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1447/2877] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:18.847628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:18.849718 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:18.906552 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a914-d584-4cce-9b1a-603acee1ad0b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:18.913114 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:18.914092 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:18.914497 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:18.914907 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:18.927027 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:18.928504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:18.938195 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1431/2878] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:30:22.994612 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:22.995133 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:22.995232 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.024717 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.auth.core [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] MFA Rules not processed for user `fcbe18db4b734d26b1820f0c2928b571`. Rule list: `[]` (Enabled: `True`). {{(pid=80557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:23.025936 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:23.103926 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1448/2879] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:23.108627 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:23.123917 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd38917-fcf1-4fb0-8ba5-66809fef8276 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:23.129041 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:23.129825 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:23.130180 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:23.130526 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.131304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:23.133578 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:23.164639 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1432/2880] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 17:30:23 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:30:23.167214 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:23.178558 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeb1b1-174e-4731-a15a-6456a4b3923d None None] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:23.238222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:23.239004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:23.239184 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:23.239462 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] PATH_INFO: `/v3/users` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.240159 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:23.242134 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:23.264815 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1449/2881] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 17:30:23 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:30:23.269072 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:23.279866 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d8de2-fcda-49dc-ab46-53a7d1faad2c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:23.284649 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:23.285331 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:23.285628 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:23.285931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.286665 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:23.288332 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:23.300947 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1433/2882] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:30:23.305250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:23.317217 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e087-442c-4514-9bd7-9513441c9a73 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:23.322341 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:23.323290 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:23.323534 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:23.323811 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] PATH_INFO: `/v3/projects/97e2aafafc8146c2b3b2e3d7acb390db/users/6f49bef8ef4d4854a9243dde08b783f5/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.326480 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:23.342768 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e2aafafc8146c2b3b2e3d7acb390db, user_id=6f49bef8ef4d4854a9243dde08b783f5, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:23.345555 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:23.360566 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1450/2883] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:30:23 2022] PUT /identity/v3/projects/97e2aafafc8146c2b3b2e3d7acb390db/users/6f49bef8ef4d4854a9243dde08b783f5/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:30:23.364580 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:23.375400 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a847-fcac-481b-a8fa-a4fa66236af2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:23.433525 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471647e3-a13d-4e5a-871c-83377187e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:23.434388 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471647e3-a13d-4e5a-871c-83377187e94a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:23.434754 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471647e3-a13d-4e5a-871c-83377187e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:23.435070 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471647e3-a13d-4e5a-871c-83377187e94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.435822 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471647e3-a13d-4e5a-871c-83377187e94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:23.437599 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471647e3-a13d-4e5a-871c-83377187e94a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:23.448739 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1434/2884] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 17:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:30:23.452861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:23.463753 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c7e50-4195-4d43-a532-1f96d7b507bd admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:23.468655 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:23.469585 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:23.469842 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:23.470124 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] PATH_INFO: `/v3/projects/97e2aafafc8146c2b3b2e3d7acb390db/users/6f49bef8ef4d4854a9243dde08b783f5/roles/7fac209687fe417482cb8fa1e13ddbbe` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:23.472095 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e2aafafc8146c2b3b2e3d7acb390db, user_id=6f49bef8ef4d4854a9243dde08b783f5, role_id=7fac209687fe417482cb8fa1e13ddbbe)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:23.474832 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:23.508710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1451/2885] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 17:30:23 2022] PUT /identity/v3/projects/97e2aafafc8146c2b3b2e3d7acb390db/users/6f49bef8ef4d4854a9243dde08b783f5/roles/7fac209687fe417482cb8fa1e13ddbbe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:30:27.964052 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966def8-afee-4681-9548-5f54a11c3ff9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:27.964504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966def8-afee-4681-9548-5f54a11c3ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:27.964780 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966def8-afee-4681-9548-5f54a11c3ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:28.000738 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3966def8-afee-4681-9548-5f54a11c3ff9 None None] MFA Rules not processed for user `6f49bef8ef4d4854a9243dde08b783f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:28.002201 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3966def8-afee-4681-9548-5f54a11c3ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:28.064111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:28.087737 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1435/2886] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:28.104898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:28.106971 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:28.199735 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a0f1f-ec37-4637-924e-2f18014f1273 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:28.205482 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:28.206132 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:28.206419 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:28.206700 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:28.280160 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:28.281834 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:28.292233 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1452/2887] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:30:29.300150 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:29.300680 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:29.300783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:29.318724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] MFA Rules not processed for user `fcbe18db4b734d26b1820f0c2928b571`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:30:29.319934 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:29.327311 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1436/2888] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 17:30:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:30:38.287342 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=71,keystone:INSERT=2 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:39.313491 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:43.851128 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:43.852838 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:43.916349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed534f4d-498d-4cce-af3e-c7777543c8ff service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:43.920243 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:43.921071 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:43.921390 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:43.921646 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:43.925695 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:43.936256 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:43.937851 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:43.946486 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1453/2889] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:30:44.433304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:44.435576 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:44.508702 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf479b-1c04-4cad-aade-5d084f99295b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:44.514918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:44.515577 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:44.515862 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:44.516142 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:44.518154 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:44.529742 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:44.531448 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:44.542152 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1437/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:30:53.942444 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=26 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:54.537108 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=32 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:55.823648 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:55.848702 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75160f05-3354-4329-83c9-662119d2c83e service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:55.856227 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:55.856934 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:55.857222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:55.857499 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:55.860245 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:55.889079 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:55.890747 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:55.902652 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1454/2891] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:30:57.437341 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:30:57.438931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:57.480421 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c84f86-2b58-4437-8a8d-e4ca99968304 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:30:57.486097 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:30:57.486814 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:30:57.487143 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:30:57.487463 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:30:57.489371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:30:57.503307 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:30:57.505060 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:30:57.526352 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1438/2892] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:30:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:31:00.105371 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:31:00.116304 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ec746-3cd0-4d52-9573-8cdba63e1c36 service placement] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:31:00.120573 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:31:00.121263 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:31:00.121550 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:31:00.121822 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:31:00.133607 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:31:00.135356 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:31:00.148349 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1455/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:31:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:31:07.512044 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=15 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:31:10.141701 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=21 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:32:56.622210 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:32:56.637953 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141a33-b417-43f6-931a-f0ba4c5da701 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:32:56.645618 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:32:56.646572 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:32:56.646948 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:32:56.647304 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:32:56.649931 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:32:56.664906 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:32:56.666394 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:32:56.677967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1439/2894] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:32:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:32:57.866860 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:32:57.878710 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267eaa-25f4-42e6-b5c6-7e842b0df481 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:32:57.884473 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:32:57.885179 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:32:57.885467 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:32:57.886106 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:32:57.888222 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:32:57.902491 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:32:57.903949 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:32:57.915626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1456/2895] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:32:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:33:06.673028 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:33:06.777292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:33:06.786530 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2826c-572f-4463-afbe-28f2983018db service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:33:06.790454 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:33:06.791111 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:33:06.791390 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:33:06.791664 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:33:06.793729 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:33:06.803980 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:33:06.805460 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:33:06.813644 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1440/2896] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:33:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:33:07.910563 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:33:09.981876 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:33:09.990782 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd79d3-b38d-4359-896b-6818f4e395bb service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:33:09.994941 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:33:09.995580 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:33:09.995866 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:33:09.996142 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:33:09.998218 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:33:10.008514 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:33:10.010004 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:33:10.018549 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1457/2897] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:33:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:33:10.101293 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:33:10.110061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14e8a-23b1-4035-9506-9be8ce3dbc04 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:33:10.113728 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9584ad1287d346f89ef31dd00dc1609c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:33:10.114426 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:33:10.114704 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:33:10.114982 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:33:10.116783 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:33:10.129967 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:33:10.131420 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:33:10.142477 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1441/2898] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:33:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:33:20.015212 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=6 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:33:20.137868 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=12 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:31.121097 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:34:31.138196 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3dd40-247b-4862-985d-7c2d53e5f693 service neutron] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:34:31.145228 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c6f9c481ec4108a86db440cc90311f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:34:31.146208 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:34:31.146497 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:34:31.146781 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:34:31.148729 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:34:31.161997 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:34:31.163633 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:34:31.176787 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1458/2899] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:34:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:34:37.855119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:34:37.867314 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e95fc0-a091-4eb4-b879-5a443cf2a39c service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:34:37.873615 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:34:37.874292 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:34:37.874835 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:34:37.875333 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:34:37.877371 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:34:37.894722 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:34:37.896581 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:34:37.918367 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1442/2900] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:34:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:34:41.100898 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:34:41.166992 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aae0af-0b45-42f3-8f99-a3fffb3da0a8 service nova] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:34:41.174877 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:34:41.176224 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:34:41.176592 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:34:41.177036 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] PATH_INFO: `/v3/users/fcbe18db4b734d26b1820f0c2928b571` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:34:41.178582 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbe18db4b734d26b1820f0c2928b571)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:34:41.181605 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:34:41.241420 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbe18db4b734d26b1820f0c2928b571'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.248452 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbe18db4b734d26b1820f0c2928b571'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.260312 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbe18db4b734d26b1820f0c2928b571'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.261619 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbe18db4b734d26b1820f0c2928b571'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.270688 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbe18db4b734d26b1820f0c2928b571'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.277287 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1459/2901] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:34:41 2022] DELETE /identity/v3/users/fcbe18db4b734d26b1820f0c2928b571 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:34:41.457656 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:34:41.470435 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc17f7b-3980-4039-bc1c-43543b1ed010 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:34:41.537119 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:34:41.538013 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:34:41.538305 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:34:41.538586 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] PATH_INFO: `/v3/projects/62a064d446ad4feea4888963e9db6511` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:34:41.539794 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a064d446ad4feea4888963e9db6511)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:34:41.541779 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:34:41.601724 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a064d446ad4feea4888963e9db6511', 'request_id': 'req-73d49068-a6b2-4856-90d8-4afa4199824b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.608377 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a064d446ad4feea4888963e9db6511', 'request_id': 'req-73d49068-a6b2-4856-90d8-4afa4199824b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.619302 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a064d446ad4feea4888963e9db6511', 'request_id': 'req-73d49068-a6b2-4856-90d8-4afa4199824b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.635788 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] The token cache is being invalidate because project 62a064d446ad4feea4888963e9db6511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:34:41.636159 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.636965 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.639291 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1443/2902] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:34:41 2022] DELETE /identity/v3/projects/62a064d446ad4feea4888963e9db6511 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:34:41.643489 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:34:41.644958 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:34:41.658335 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142a24-14dd-42c2-80cb-3a03c364c9b4 admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:34:41.718626 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:34:41.719521 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:34:41.719810 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:34:41.720085 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] PATH_INFO: `/v3/users/6f49bef8ef4d4854a9243dde08b783f5` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:34:41.721308 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f49bef8ef4d4854a9243dde08b783f5)` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:34:41.723276 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:34:41.728973 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:41.779332 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f49bef8ef4d4854a9243dde08b783f5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.786365 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f49bef8ef4d4854a9243dde08b783f5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.798987 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f49bef8ef4d4854a9243dde08b783f5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.800049 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f49bef8ef4d4854a9243dde08b783f5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.808458 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.notifications [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f49bef8ef4d4854a9243dde08b783f5'} {{(pid=80557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:41.814861 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1460/2903] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 17:34:41 2022] DELETE /identity/v3/users/6f49bef8ef4d4854a9243dde08b783f5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:34:41.999880 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:34:42.001399 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:34:42.015034 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49068-a6b2-4856-90d8-4afa4199824b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:34:42.074362 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef11ad96d374697895a79e0a7fd9e82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549ef6c44d2245c896f7c092456b7282', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:34:42.075257 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:34:42.075545 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:34:42.075828 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] PATH_INFO: `/v3/projects/97e2aafafc8146c2b3b2e3d7acb390db` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:34:42.077351 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e2aafafc8146c2b3b2e3d7acb390db)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:34:42.079315 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:34:42.102544 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:42.134472 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e2aafafc8146c2b3b2e3d7acb390db', 'request_id': 'req-a6f9e933-1504-4db6-a205-bd57ed9caf68'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:42.142918 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e2aafafc8146c2b3b2e3d7acb390db', 'request_id': 'req-a6f9e933-1504-4db6-a205-bd57ed9caf68'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:42.152504 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e2aafafc8146c2b3b2e3d7acb390db', 'request_id': 'req-a6f9e933-1504-4db6-a205-bd57ed9caf68'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:42.165061 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] The token cache is being invalidate because project 97e2aafafc8146c2b3b2e3d7acb390db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:34:42.165356 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:42.166055 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a6f9e933-1504-4db6-a205-bd57ed9caf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:34:42.167895 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1444/2904] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 17:34:41 2022] DELETE /identity/v3/projects/97e2aafafc8146c2b3b2e3d7acb390db => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:34:51.811235 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:52.162012 dv-cinder-842998-1-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:36:00.817786 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Authenticating user token {{(pid=80557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:36:00.819250 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:36:00.900663 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c9886-46ee-4f94-b08b-1958f44abb2e admin admin] Validating token access rules against request {{(pid=80557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:36:00.972737 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08c27893964a4cc2a798f33a91844833', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '444a244a713944db9caf259034ccd231', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:36:00.973406 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] REQUEST_METHOD: `GET` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:36:00.973698 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] SCRIPT_NAME: `/identity` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:36:00.973981 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:36:00.975950 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.fernet_utils [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:36:00.987748 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:36:00.989412 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627380-3127-4630-b502-1ecd96fa0c95 service placement] RBAC: Authorization granted {{(pid=80557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:36:00.999689 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: [pid: 80557|app: 0|req: 1461/2905] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 17:36:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 17:36:10.995432 dv-cinder-842998-1-iscsi devstack@keystone.service[80557]: DEBUG dbcounter [-] [80557] Writing DB stats keystone:SELECT=58 {{(pid=80557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}